-- Logs begin at Sat 2022-10-01 20:01:15 UTC, end at Sat 2022-10-01 20:59:12 UTC. -- Oct 01 20:31:28.767890 dv-osbrick-master-4-ceph systemd[1]: Starting Devstack devstack@keystone.service... Oct 01 20:31:28.775314 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 01 20:31:28.778834 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Oct 1 20:31:28 2022] *** Oct 01 20:31:28.778834 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 01 20:31:28.778834 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 01 20:31:28.778834 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: nodename: dv-osbrick-master-4-ceph Oct 01 20:31:28.778834 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: machine: x86_64 Oct 01 20:31:28.778834 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: clock source: unix Oct 01 20:31:28.778834 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: pcre jit disabled Oct 01 20:31:28.778834 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: detected number of CPU cores: 4 Oct 01 20:31:28.778834 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: current working directory: / Oct 01 20:31:28.778834 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: detected binary path: /usr/bin/uwsgi-core Oct 01 20:31:28.778834 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: your processes number limit is 47680 Oct 01 20:31:28.778834 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: your memory page size is 4096 bytes Oct 01 20:31:28.778834 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: detected max file descriptor number: 2048 Oct 01 20:31:28.778834 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: lock engine: pthread robust mutexes Oct 01 20:31:28.778834 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: thunder lock: enabled Oct 01 20:31:28.778834 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 01 20:31:28.779660 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 01 20:31:28.824153 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: Python main interpreter initialized at 0x55bf7be1d9c0 Oct 01 20:31:28.824153 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: python threads support enabled Oct 01 20:31:28.824153 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: your server socket listen backlog is limited to 100 connections Oct 01 20:31:28.824153 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: your mercy for graceful operations on workers is 90 seconds Oct 01 20:31:28.824567 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: mapped 403077 bytes (393 KB) for 2 cores Oct 01 20:31:28.824650 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: *** Operational MODE: preforking *** Oct 01 20:31:28.824868 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: *** uWSGI is running in multiple interpreter mode *** Oct 01 20:31:28.824868 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: spawned uWSGI master process (pid: 94742) Oct 01 20:31:28.825078 dv-osbrick-master-4-ceph systemd[1]: Started Devstack devstack@keystone.service. Oct 01 20:31:28.826285 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: spawned uWSGI worker 1 (pid: 94755, cores: 1) Oct 01 20:31:28.826285 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: spawned uWSGI worker 2 (pid: 94756, cores: 1) Oct 01 20:31:28.826285 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 01 20:31:33.479384 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 01 20:31:33.479384 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: from cryptography.utils import int_from_bytes Oct 01 20:31:33.480301 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 01 20:31:33.480301 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: from cryptography.utils import int_from_bytes Oct 01 20:31:33.482876 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 01 20:31:33.482876 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: from cryptography.utils import int_from_bytes Oct 01 20:31:33.483369 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 01 20:31:33.483369 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: from cryptography.utils import int_from_bytes Oct 01 20:31:33.530129 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 01 20:31:33.530318 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 01 20:31:33.530458 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 01 20:31:33.530564 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] command line args: [] {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 01 20:31:33.530653 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 01 20:31:33.530735 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 01 20:31:33.530839 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] command line args: [] {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 01 20:31:33.530927 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] ================================================================================ {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 01 20:31:33.531104 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 01 20:31:33.531194 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] admin_token = **** {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:31:33.531268 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] ================================================================================ {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 01 20:31:33.531381 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] config_dir = [] {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:31:33.531507 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] admin_token = **** {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:31:33.531594 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:31:33.531734 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] config_source = [] {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:31:33.531820 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] config_dir = [] {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:31:33.531913 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] debug = True {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:31:33.531998 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:31:33.532075 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] config_source = [] {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:31:33.532152 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:31:33.532411 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] debug = True {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:31:33.532516 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:31:33.532670 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:31:33.532670 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] insecure_debug = False {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:31:33.532869 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:31:33.532869 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] insecure_debug = False {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:31:33.533072 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:31:33.533175 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:31:33.533278 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:31:33.533381 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:31:33.533495 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] list_limit = None {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:31:33.533495 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] log_config_append = None {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:31:33.533673 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] list_limit = None {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:31:33.534283 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:31:33.534394 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] log_config_append = None {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:31:33.534497 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] log_dir = None {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:31:33.534602 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:31:33.534704 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] log_file = None {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:31:33.534809 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] log_dir = None {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:31:33.534809 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] log_file = None {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:31:33.535058 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:31:33.535133 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:31:33.535271 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:31:33.535384 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:31:33.535504 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:31:33.535581 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:31:33.535696 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:31:33.535780 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:31:33.535866 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:31:33.535941 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:31:33.536058 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:31:33.536141 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:31:33.536219 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:31:33.536345 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:31:33.536428 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:31:33.536511 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:31:33.536627 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:31:33.536745 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:31:33.536825 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:31:33.536975 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:31:33.537051 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:31:33.537203 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:31:33.537282 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:31:33.537429 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:31:33.537508 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:31:33.537670 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:31:33.537750 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] notification_format = cadf {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:31:33.537909 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] notification_format = cadf {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:31:33.538036 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:31:33.538176 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:31:33.538442 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.23/identity {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:31:33.538624 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] publish_errors = False {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:31:33.538705 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.23/identity {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:31:33.538822 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] publish_errors = False {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:31:33.538907 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:31:33.539048 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:31:33.539133 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:31:33.539227 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:31:33.539310 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:31:33.539431 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:31:33.539516 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:31:33.539670 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:31:33.539751 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:31:33.539900 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:31:33.539988 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] standard_threads = False {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:31:33.540125 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] strict_password_check = False {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:31:33.540209 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] standard_threads = False {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:31:33.540348 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] strict_password_check = False {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:31:33.540425 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:31:33.540574 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] use_eventlog = False {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:31:33.540657 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:31:33.540736 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] use_journal = False {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:31:33.540809 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] use_eventlog = False {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:31:33.540879 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] use_json = False {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:31:33.540955 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] use_journal = False {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:31:33.541035 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] use_stderr = False {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:31:33.541113 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] use_json = False {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:31:33.541185 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] use_syslog = False {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:31:33.541261 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] use_stderr = False {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:31:33.541403 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] use_syslog = False {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:31:33.541482 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] watch_log_file = False {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:31:33.541627 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] watch_log_file = False {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:31:33.541707 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.541875 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.541954 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.542108 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.542187 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.542358 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.542463 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.542591 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.542700 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.542832 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.542935 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.543065 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.543170 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.543299 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.543379 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.543529 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.543606 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.543771 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.543851 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.544013 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.544091 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.544244 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.544322 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.544475 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.544600 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.544739 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.544819 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.544971 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.545049 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.545211 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.545291 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.545444 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.545523 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.545674 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.545752 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.545906 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.545987 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.546158 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.546242 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.546391 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.546469 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.546620 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.546699 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.546867 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.546952 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.547123 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.547202 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.547367 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.547447 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.547595 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.547673 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.547818 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.547903 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.548042 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.548127 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.548266 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.548343 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.548495 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.548634 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.548759 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.548838 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.548986 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.549063 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.549210 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.549299 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.549493 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.550151 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.550273 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.550353 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.550513 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.550603 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.550761 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.550840 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.550992 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.551076 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.551224 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.551313 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.551458 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.551540 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.551687 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.551770 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.551914 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.552070 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.552152 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.552224 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.552353 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.552431 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.552601 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.552698 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.552835 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.552914 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.553065 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.553141 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.553291 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.553382 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.553518 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.553595 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.553738 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.553815 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.553973 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.554060 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.554200 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.554277 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.554437 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.554519 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.554660 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.554745 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.554892 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.554971 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.555121 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.555199 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.555351 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.555443 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.555580 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.555660 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.555810 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.555920 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.556033 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.556173 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.556276 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.556412 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.556499 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.556671 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.556764 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.556908 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.557001 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.557169 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.557321 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.557408 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.557556 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.557635 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.557783 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.557871 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.558023 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.558104 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.558256 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.558335 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.558521 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.558603 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.558768 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.558850 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.559013 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.559099 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.559253 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.559334 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.559486 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.559575 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.559719 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.559799 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.559953 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.560035 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] cache.enabled = True {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.560188 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.560267 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] cache.enabled = True {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.560420 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.560498 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.560677 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.560760 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.560915 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.560993 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.561148 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.561226 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.561390 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.561470 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.561623 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.561709 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.561855 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.561935 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.562088 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.562169 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.562319 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.562398 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.562551 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.562630 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.562806 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.562886 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.563051 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.563130 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.563290 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.563368 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.563517 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.563592 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.563753 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.563841 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.563989 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.564067 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.564221 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.564310 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.564454 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.564554 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.564704 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.564782 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.564930 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.565033 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.565238 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.565371 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.565473 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.565710 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.565802 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.565876 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.565959 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.566034 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.566151 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.566231 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.566399 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.566491 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.566642 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.566722 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.566899 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.566978 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.567156 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.567244 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.567396 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.567475 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.567628 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] auth.external = None {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.567722 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.567855 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] auth.external = None {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.567934 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] auth.mapped = None {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.568081 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] auth.mapped = None {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.568169 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.568369 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.568448 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.568621 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] auth.password = None {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.568715 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.568850 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] auth.password = None {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.568941 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] auth.token = None {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.569075 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] auth.token = None {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.569156 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.569565 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.569653 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] catalog.caching = True {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.569797 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] catalog.caching = True {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.569885 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.570029 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.570109 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.570255 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.570335 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.570499 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.570588 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.570728 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.570807 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.570953 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.571032 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] credential.caching = True {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.571183 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] credential.caching = True {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.571271 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] credential.driver = sql {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.571426 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] credential.driver = sql {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.571506 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.571668 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.571749 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.571910 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.571998 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.572151 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.572231 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.572386 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.572465 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.572639 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.572733 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.572881 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.572961 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.573119 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.573198 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.573355 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.573443 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.573603 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.573686 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.573871 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.573949 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.574111 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.574197 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.574362 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.574441 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.574597 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.574677 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.574838 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] federation.caching = True {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.574925 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.575066 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] federation.caching = True {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.575146 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.575295 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.575380 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] federation.driver = sql {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.575535 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] federation.driver = sql {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.575624 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.575761 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.575841 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.575987 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.576072 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.576227 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.576323 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.576459 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.576579 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.576735 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.576817 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.576967 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.577060 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.577218 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.577298 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.577450 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.577529 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.577680 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] identity.caching = True {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.577757 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.577911 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] identity.caching = True {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.577992 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.578155 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.578235 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.578389 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.578470 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.578619 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.578698 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.578850 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.578930 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] identity.driver = sql {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.579079 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.579166 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] identity.driver = sql {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.579306 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.579394 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.579537 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.579616 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.579780 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.579867 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.580008 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.580087 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.580237 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.580316 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.580462 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.580641 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.580722 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.580856 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.581086 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.581163 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.581246 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.581420 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.581507 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.581670 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.581751 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.581910 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.582001 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.582173 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.582254 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.582404 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.582484 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.582635 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.582724 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.582862 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.582943 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.583093 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.583173 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.583319 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.583410 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.583548 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.583629 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.583781 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.583862 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.584016 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.584105 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.584257 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.584338 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.584480 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.584612 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.584764 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.584859 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.585006 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.585088 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.585234 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.585315 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.585474 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.585566 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.585714 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.585795 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.585937 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.586017 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.586168 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.586257 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.586392 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] ldap.password = **** {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.586473 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] ldap.password = **** {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.586622 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.586702 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.586851 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.586941 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.587084 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.587165 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.587313 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.587393 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.587543 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.587631 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.587784 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.587865 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.588027 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.588106 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.588249 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.588337 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.588473 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.588585 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.588739 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.588821 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.588987 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.589068 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.589220 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.589300 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.589448 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.589527 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.589680 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.589762 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.589904 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] ldap.user = None {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.589985 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] ldap.user = None {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.590138 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.590217 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.590392 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.590475 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.590616 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.590696 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.590855 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.590936 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.591095 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.591177 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.591334 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.591415 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.591561 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.591641 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.591783 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.591865 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.592011 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.592092 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.592243 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.592374 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.592517 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.592727 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.592804 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.592876 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.592949 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.593021 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.593165 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.593249 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.593405 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.593486 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.593645 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.593726 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.593885 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.593967 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.594109 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.594189 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.594349 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.594433 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.594582 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.594665 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.594812 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.594893 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.595040 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.595121 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.595269 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.595352 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.595505 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.595585 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.595744 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.595825 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.595975 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.596047 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.596744 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] policy.driver = sql {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.596834 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] policy.driver = sql {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.597000 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.597164 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.597258 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.597416 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.597497 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.597649 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.597730 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] receipt.caching = True {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.597882 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] receipt.caching = True {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.597971 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.598113 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.598193 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.598355 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.598435 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.598589 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.598677 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.598813 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.598893 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.599045 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.599125 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] resource.caching = True {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.599280 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] resource.caching = True {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.599373 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.599524 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] resource.driver = sql {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.599604 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.599761 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.599841 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] resource.driver = sql {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.599988 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.600076 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.600230 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.600311 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.600462 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] revoke.caching = True {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.600559 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.600722 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] revoke.caching = True {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.600877 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.600957 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.601018 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.601180 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] role.cache_time = None {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.601413 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] role.caching = True {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.601512 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.601657 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] role.driver = sql {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.601739 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] role.cache_time = None {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.601887 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] role.list_limit = None {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.602034 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] role.caching = True {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.602135 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.602206 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] role.driver = sql {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.602383 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.602454 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] role.list_limit = None {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.602636 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.602762 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.602884 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.603018 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.603136 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.603250 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.603378 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.603502 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.603626 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.603762 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.603895 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.604014 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.604140 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.604268 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.604395 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.604591 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.604725 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.604856 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.604987 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.605123 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.605254 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.605403 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.605537 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.605537 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.605776 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.605776 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.606001 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.606141 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.606265 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.606399 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.606530 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.606660 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.606794 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.606941 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.607075 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.607207 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.607372 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.607510 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.607647 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.607647 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.607909 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.608025 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.608104 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.608177 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.608177 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.608320 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.608393 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.608495 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.608653 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.608763 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.609014 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.609097 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.609256 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.609499 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.609770 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.610024 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.610264 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.610508 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.610632 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.610858 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.610939 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] token.cache_time = None {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.611105 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] token.cache_time = None {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.611355 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] token.caching = True {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.611442 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] token.caching = True {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.611601 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.611811 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.611955 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] token.provider = fernet {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.612821 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] token.provider = fernet {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.613075 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.613290 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.613436 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.613576 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.613714 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.613851 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.614004 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.614141 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.614271 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.614271 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.614499 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.614632 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] trust.driver = sql {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.614779 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.614915 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.615051 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] trust.driver = sql {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.615186 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.615320 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.615455 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.615601 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.615736 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.615860 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.615860 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.615992 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.615992 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.616125 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.616394 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.616677 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] database.connection = **** {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.616933 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.617182 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.617419 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.617490 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.617662 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.617735 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.617964 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.618044 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.618244 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.618405 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.618526 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] database.connection = **** {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.618779 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.618869 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.619034 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.619279 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.619359 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.619524 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.619753 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.619847 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.619990 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.620199 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.620280 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.620446 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.620752 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.621009 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.621270 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.621517 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.621771 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.622007 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.622252 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.622491 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.622663 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=94755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 01 20:31:33.622743 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.623010 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.623261 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.623499 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.623749 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.623986 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.624230 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.624461 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.624744 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.624981 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:31:33.625153 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=94756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 01 20:31:33.652062 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=94755) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 20:31:33.652292 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=94755) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 20:31:33.652518 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=94755) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 20:31:33.653480 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=94756) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 20:31:33.653707 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=94756) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 20:31:33.653927 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=94756) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 20:31:33.661570 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=94755) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 20:31:33.662938 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=94756) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 20:31:33.691300 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=94755) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 20:31:33.691521 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=94755) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 20:31:33.692213 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=94756) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 20:31:33.692441 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=94756) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 20:31:33.743846 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=94755) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 20:31:33.744670 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=94756) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 20:31:33.792749 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=94756) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 20:31:33.792970 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=94756) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 20:31:33.793347 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=94755) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 20:31:33.793581 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=94755) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 20:31:33.859540 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=94756) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 20:31:33.859759 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=94756) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 20:31:33.859975 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=94756) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 20:31:33.860061 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=94755) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 20:31:33.860188 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=94756) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 20:31:33.860272 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=94755) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 20:31:33.860399 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=94756) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 20:31:33.860492 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=94755) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 20:31:33.860633 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=94756) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 20:31:33.860719 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=94755) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 20:31:33.860894 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=94755) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 20:31:33.861106 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=94755) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 20:31:33.883985 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=94756) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 20:31:33.884186 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=94755) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 20:31:33.884302 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=94756) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 20:31:33.884415 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=94755) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 20:31:33.884543 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=94756) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 20:31:33.884666 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=94755) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 20:31:33.884766 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=94756) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 20:31:33.884889 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=94755) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 20:31:33.884973 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=94756) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 20:31:33.885107 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=94755) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 20:31:33.885189 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=94756) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 20:31:33.885323 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=94755) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 20:31:33.885406 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=94756) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 20:31:33.885535 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=94755) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 20:31:33.897433 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=94755) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 20:31:33.897558 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=94756) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 20:31:33.911536 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=94755) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 20:31:33.911767 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=94755) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 20:31:33.911991 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=94755) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 20:31:33.912208 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=94755) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 20:31:33.912420 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=94755) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 20:31:33.912651 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=94755) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 20:31:33.912862 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=94755) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 20:31:33.914255 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=94756) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 20:31:33.914485 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=94756) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 20:31:33.914705 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=94756) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 20:31:33.914920 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=94756) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 20:31:33.915135 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=94756) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 20:31:33.915342 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=94756) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 20:31:33.915550 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=94756) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 20:31:33.930677 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=94755) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:33.930886 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=94755) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 01 20:31:33.931028 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=94756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:33.931228 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=94755) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:33.931315 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=94756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 01 20:31:33.931427 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=94755) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 01 20:31:33.931571 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=94756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:33.931702 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=94755) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:33.931793 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=94756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 01 20:31:33.931966 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=94755) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:33.932047 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=94756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:33.932227 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=94755) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:33.932307 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=94756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:33.932484 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=94755) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:33.932586 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=94756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:33.932802 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=94756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:33.942109 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=94755) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:33.942361 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=94756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:33.942445 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=94755) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:33.942638 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=94756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:33.942721 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=94755) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:33.942907 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=94756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:33.942989 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=94755) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:33.943186 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=94756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:33.950144 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=94755) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 01 20:31:33.950375 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=94756) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 01 20:31:33.953125 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=94755) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 01 20:31:33.953268 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=94756) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 01 20:31:33.953414 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=94755) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:33.953550 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=94756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:33.953694 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=94755) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:33.953830 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=94756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:33.953972 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=94755) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:33.954111 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=94756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:33.954250 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=94755) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:33.954393 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=94756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:33.954526 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=94755) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:33.954650 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=94756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:33.954795 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=94755) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:33.954914 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=94756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:33.955076 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=94755) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:33.955183 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=94756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:33.955357 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=94755) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:33.955458 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=94756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:33.956168 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=94755) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:33.956267 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=94756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:33.956439 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=94755) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:33.956551 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=94756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:33.980479 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=94756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:33.981030 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=94755) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:33.981961 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=94756) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 01 20:31:33.982243 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=94756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:33.982501 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=94755) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 01 20:31:33.982787 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=94755) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:33.986759 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=94756) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 01 20:31:33.987667 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=94756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:33.987885 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=94755) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 01 20:31:33.988075 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=94756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:33.988157 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=94755) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:33.988574 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=94755) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:33.994519 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=94756) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 01 20:31:33.994764 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=94756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:33.994909 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=94755) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 01 20:31:33.995203 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=94755) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:33.998750 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=94756) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 01 20:31:33.999040 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=94756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:33.999171 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=94755) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 01 20:31:33.999320 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=94756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:33.999465 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=94755) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:33.999708 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=94756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:33.999789 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=94755) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:33.999993 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=94756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.000120 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=94755) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.000264 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=94756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.000398 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=94755) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.000565 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=94756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.000698 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=94755) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.000848 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=94756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.000971 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=94755) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.001243 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=94755) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.016439 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=94756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.016747 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=94756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.017098 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=94755) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.017383 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=94755) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.021108 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=94756) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 01 20:31:34.021818 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=94755) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 01 20:31:34.024203 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=94756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.024631 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=94756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.024936 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=94755) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.025345 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=94755) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.028830 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=94756) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 01 20:31:34.029566 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=94755) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 01 20:31:34.031953 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=94756) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 01 20:31:34.032720 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=94755) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 01 20:31:34.035613 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=94756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.035911 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=94756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.036206 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=94756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.036417 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=94755) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.036639 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=94756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.036753 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=94755) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.036922 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=94756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.037041 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=94755) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.037202 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=94756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.037462 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=94755) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.037749 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=94755) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.038038 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=94755) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.053544 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=94756) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 01 20:31:34.053841 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=94756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.054108 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=94756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.054367 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=94756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.055144 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=94755) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 01 20:31:34.055434 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=94755) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.055706 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=94755) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.055972 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=94755) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.061079 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=94756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.062730 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=94756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.062821 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=94755) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.064271 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=94756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.064445 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=94755) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.064557 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=94756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.066081 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=94755) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.066356 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=94755) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.067406 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=94756) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 01 20:31:34.067696 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=94756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.067988 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=94756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.068266 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=94756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.068555 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=94756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.069031 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=94755) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 01 20:31:34.069589 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=94755) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.069874 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=94755) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.070157 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=94755) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.070438 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=94755) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.079990 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=94756) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 01 20:31:34.080276 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=94756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.081355 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=94756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.081659 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=94756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.081949 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=94756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.082228 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=94756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.082502 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=94756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.083053 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=94755) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 01 20:31:34.083530 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=94755) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.084022 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=94755) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.084327 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=94755) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.084651 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=94755) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.084938 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=94755) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.085230 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=94755) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.100192 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=94756) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 01 20:31:34.102611 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=94755) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 01 20:31:34.103220 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=94756) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 01 20:31:34.105680 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=94755) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 01 20:31:34.106124 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=94756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.107546 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=94756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.108619 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=94755) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.109042 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=94756) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 01 20:31:34.109331 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=94756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.109613 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=94756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.110067 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=94755) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.111551 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=94755) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 01 20:31:34.111891 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=94755) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.112285 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=94755) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.116159 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=94756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.117666 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=94756) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 01 20:31:34.118952 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=94755) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.120427 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=94755) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 01 20:31:34.120508 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=94756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.120800 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=94756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.121086 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=94756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.121360 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=94756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.123390 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=94755) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.123780 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=94755) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.124067 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=94755) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.124353 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=94755) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.130977 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=94756) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 01 20:31:34.131281 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=94756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.131558 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=94756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.134029 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=94755) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 01 20:31:34.134327 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=94755) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.134613 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=94755) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.138438 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=94756) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 01 20:31:34.138721 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=94756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.138999 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=94756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.139273 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=94756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.139546 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=94756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.139828 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=94756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.140100 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=94756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.140389 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=94756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.140711 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=94756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.140979 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=94756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.141254 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=94756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.141512 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=94755) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 01 20:31:34.141602 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=94756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.141774 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=94756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.141900 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=94755) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.142030 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=94756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.142111 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=94755) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.142335 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=94755) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.142608 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=94755) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.142888 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=94755) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.143253 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=94755) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.143540 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=94755) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.143898 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=94755) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.144174 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=94755) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.144448 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=94755) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.144736 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=94755) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.145013 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=94755) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.145274 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=94755) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 20:31:34.176127 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bf7be1d9c0 pid: 94756 (default app) Oct 01 20:31:34.179491 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bf7be1d9c0 pid: 94755 (default app) Oct 01 20:31:34.179629 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c091b38-ad6a-43d0-a12b-79e0971d0578 None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:31:34.179911 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c091b38-ad6a-43d0-a12b-79e0971d0578 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:31:34.180184 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c091b38-ad6a-43d0-a12b-79e0971d0578 None None] PATH_INFO: `/v3` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:31:34.184642 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 1/1] 10.222.0.23 () {50 vars in 791 bytes} [Sat Oct 1 20:31:34 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:31:41.485510 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b3d74-e95b-4228-8678-af68997f3e65 None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:31:41.486016 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b3d74-e95b-4228-8678-af68997f3e65 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:31:41.486098 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b3d74-e95b-4228-8678-af68997f3e65 None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:31:41.490803 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 1/2] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:31:41 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 01 20:31:41.496102 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848ef68-04c7-4b9e-8c3d-dfc334465885 None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:31:41.496667 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848ef68-04c7-4b9e-8c3d-dfc334465885 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:31:41.496667 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848ef68-04c7-4b9e-8c3d-dfc334465885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:31:41.575344 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: INFO dbcounter [None req-5848ef68-04c7-4b9e-8c3d-dfc334465885 None None] Registered counter for database keystone Oct 01 20:31:41.594072 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG oslo_db.sqlalchemy.engines [None req-5848ef68-04c7-4b9e-8c3d-dfc334465885 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94756) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 01 20:31:41.600941 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writer thread running {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 01 20:31:41.778502 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG passlib.handlers.bcrypt [None req-5848ef68-04c7-4b9e-8c3d-dfc334465885 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=94756) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 01 20:31:41.778810 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG passlib.handlers.bcrypt [None req-5848ef68-04c7-4b9e-8c3d-dfc334465885 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=94756) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 01 20:31:41.837535 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-5848ef68-04c7-4b9e-8c3d-dfc334465885 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:31:41.839138 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-5848ef68-04c7-4b9e-8c3d-dfc334465885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:31:41.966439 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 2/3] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:31:41 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 471 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 01 20:31:42.316016 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28b3d74-e95b-4228-8678-af68997f3e65 None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:31:42.392439 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: INFO dbcounter [None req-a28b3d74-e95b-4228-8678-af68997f3e65 None None] Registered counter for database keystone Oct 01 20:31:42.414545 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG oslo_db.sqlalchemy.engines [None req-a28b3d74-e95b-4228-8678-af68997f3e65 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94755) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 01 20:31:42.420695 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writer thread running {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 01 20:31:42.539958 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28b3d74-e95b-4228-8678-af68997f3e65 None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:31:42.544309 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db117ab0-eadc-46a6-a5c4-87d37f2df15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f2619d8f534f3eace3cce529462560', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:31:42.544962 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db117ab0-eadc-46a6-a5c4-87d37f2df15a admin admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:31:42.545245 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db117ab0-eadc-46a6-a5c4-87d37f2df15a admin admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:31:42.545522 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db117ab0-eadc-46a6-a5c4-87d37f2df15a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:31:42.553829 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db117ab0-eadc-46a6-a5c4-87d37f2df15a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:31:42.606186 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: WARNING keystone.common.rbac_enforcer.enforcer [None req-db117ab0-eadc-46a6-a5c4-87d37f2df15a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 01 20:31:42.606533 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db117ab0-eadc-46a6-a5c4-87d37f2df15a admin admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:31:42.616040 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 2/4] 10.222.0.23 () {58 vars in 1324 bytes} [Sat Oct 1 20:31:42 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 01 20:31:42.622121 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5848ef68-04c7-4b9e-8c3d-dfc334465885 None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:31:42.641390 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5848ef68-04c7-4b9e-8c3d-dfc334465885 None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:31:42.646373 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661a4cc5-90a9-4c69-8984-ffaaf71ea07e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f2619d8f534f3eace3cce529462560', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:31:42.647467 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a4cc5-90a9-4c69-8984-ffaaf71ea07e admin admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:31:42.647744 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a4cc5-90a9-4c69-8984-ffaaf71ea07e admin admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:31:42.648009 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a4cc5-90a9-4c69-8984-ffaaf71ea07e admin admin] PATH_INFO: `/v3/projects/15f2619d8f534f3eace3cce529462560` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:31:42.649480 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661a4cc5-90a9-4c69-8984-ffaaf71ea07e admin admin] RBAC: Authorizing `identity:get_project(project_id=15f2619d8f534f3eace3cce529462560)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:31:42.699830 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: WARNING keystone.common.rbac_enforcer.enforcer [None req-661a4cc5-90a9-4c69-8984-ffaaf71ea07e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 01 20:31:42.700167 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661a4cc5-90a9-4c69-8984-ffaaf71ea07e admin admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:31:42.704709 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 3/5] 10.222.0.23 () {56 vars in 1207 bytes} [Sat Oct 1 20:31:42 2022] GET /identity/v3/projects/15f2619d8f534f3eace3cce529462560 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 20:31:45.059820 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11054378-b509-47ed-a0cc-3de250466a77 None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:31:45.060390 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11054378-b509-47ed-a0cc-3de250466a77 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:31:45.060390 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11054378-b509-47ed-a0cc-3de250466a77 None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:31:45.064497 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 3/6] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:31:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:31:45.071271 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c2086-23f3-48a3-9fd1-388d8a7d2e57 None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:31:45.071721 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c2086-23f3-48a3-9fd1-388d8a7d2e57 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:31:45.071829 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c2086-23f3-48a3-9fd1-388d8a7d2e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:31:45.091547 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-a66c2086-23f3-48a3-9fd1-388d8a7d2e57 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:31:45.093084 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-a66c2086-23f3-48a3-9fd1-388d8a7d2e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:31:45.101069 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 4/7] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:31:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 01 20:31:45.425956 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11054378-b509-47ed-a0cc-3de250466a77 None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:31:45.437935 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11054378-b509-47ed-a0cc-3de250466a77 None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:31:45.442879 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d434d2-61b0-4cfe-927f-fac2f3531a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f2619d8f534f3eace3cce529462560', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:31:45.443472 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d434d2-61b0-4cfe-927f-fac2f3531a01 admin admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:31:45.443754 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d434d2-61b0-4cfe-927f-fac2f3531a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:31:45.444031 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d434d2-61b0-4cfe-927f-fac2f3531a01 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:31:45.451864 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d434d2-61b0-4cfe-927f-fac2f3531a01 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:31:45.453676 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d434d2-61b0-4cfe-927f-fac2f3531a01 admin admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:31:45.462897 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 4/8] 10.222.0.23 () {58 vars in 1324 bytes} [Sat Oct 1 20:31:45 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 01 20:31:45.468146 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66c2086-23f3-48a3-9fd1-388d8a7d2e57 None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:31:45.477445 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66c2086-23f3-48a3-9fd1-388d8a7d2e57 None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:31:45.481743 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7053b3a-3fee-47ce-bd2d-a74c25bffb79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f2619d8f534f3eace3cce529462560', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:31:45.482358 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7053b3a-3fee-47ce-bd2d-a74c25bffb79 admin admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:31:45.482635 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7053b3a-3fee-47ce-bd2d-a74c25bffb79 admin admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:31:45.482908 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7053b3a-3fee-47ce-bd2d-a74c25bffb79 admin admin] PATH_INFO: `/v3/users/6d59f4f70f764f57b1d8cf05402fdf0e` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:31:45.484208 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7053b3a-3fee-47ce-bd2d-a74c25bffb79 admin admin] RBAC: Authorizing `identity:get_user(user_id=6d59f4f70f764f57b1d8cf05402fdf0e)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:31:45.486049 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7053b3a-3fee-47ce-bd2d-a74c25bffb79 admin admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:31:45.487869 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 5/9] 10.222.0.23 () {56 vars in 1198 bytes} [Sat Oct 1 20:31:45 2022] GET /identity/v3/users/6d59f4f70f764f57b1d8cf05402fdf0e => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 20:31:47.956041 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8862b0ac-cfb2-4057-b59b-665c49fcefe8 None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:31:47.956629 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8862b0ac-cfb2-4057-b59b-665c49fcefe8 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:31:47.956629 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8862b0ac-cfb2-4057-b59b-665c49fcefe8 None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:31:47.957969 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 5/10] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:31:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:31:47.963197 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f690c412-3ef5-44fc-89d7-2814684c5d7e None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:31:47.963623 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f690c412-3ef5-44fc-89d7-2814684c5d7e None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:31:47.963875 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f690c412-3ef5-44fc-89d7-2814684c5d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:31:47.973251 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5f38f9-4a49-4102-be40-6a551b50bdbe None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:31:47.973531 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5f38f9-4a49-4102-be40-6a551b50bdbe None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:31:47.973804 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5f38f9-4a49-4102-be40-6a551b50bdbe None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:31:47.975087 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 6/11] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:31:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 01 20:31:47.980114 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2dad5d-a7b7-4ead-b00e-b89d5e17cfaf None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:31:47.980393 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2dad5d-a7b7-4ead-b00e-b89d5e17cfaf None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:31:47.980704 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2dad5d-a7b7-4ead-b00e-b89d5e17cfaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:31:47.982859 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-f690c412-3ef5-44fc-89d7-2814684c5d7e None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:31:47.984029 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-f690c412-3ef5-44fc-89d7-2814684c5d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:31:48.023105 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG passlib.handlers.bcrypt [None req-7d2dad5d-a7b7-4ead-b00e-b89d5e17cfaf None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=94755) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 01 20:31:48.023504 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG passlib.handlers.bcrypt [None req-7d2dad5d-a7b7-4ead-b00e-b89d5e17cfaf None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=94755) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 01 20:31:48.073381 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-7d2dad5d-a7b7-4ead-b00e-b89d5e17cfaf None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:31:48.075018 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-7d2dad5d-a7b7-4ead-b00e-b89d5e17cfaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:31:48.189581 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 6/12] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:31:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 20:31:48.200709 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 7/13] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:31:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 01 20:31:48.518075 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f690c412-3ef5-44fc-89d7-2814684c5d7e None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:31:48.518265 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2dad5d-a7b7-4ead-b00e-b89d5e17cfaf None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:31:48.544047 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:31:48.619432 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:31:48.622255 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2dad5d-a7b7-4ead-b00e-b89d5e17cfaf None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:31:48.624743 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f690c412-3ef5-44fc-89d7-2814684c5d7e None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:31:48.662008 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0522692-2163-4ab9-8f89-141fb4c793db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:31:48.662886 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0522692-2163-4ab9-8f89-141fb4c793db None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:31:48.663168 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0522692-2163-4ab9-8f89-141fb4c793db None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:31:48.663439 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0522692-2163-4ab9-8f89-141fb4c793db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:31:48.665518 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dceff1-c1d6-44c8-ab32-c67b85f21d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:31:48.666161 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dceff1-c1d6-44c8-ab32-c67b85f21d4e None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:31:48.666435 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dceff1-c1d6-44c8-ab32-c67b85f21d4e None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:31:48.666709 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dceff1-c1d6-44c8-ab32-c67b85f21d4e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:31:48.678590 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dceff1-c1d6-44c8-ab32-c67b85f21d4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 20:31:48.687359 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application [None req-f5dceff1-c1d6-44c8-ab32-c67b85f21d4e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 20:31:48.687359 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:31:48.687359 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:31:48.687359 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:31:48.687359 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:31:48.687359 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:31:48.687359 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:31:48.687359 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:31:48.687359 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:31:48.687359 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:31:48.687359 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:31:48.687359 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:31:48.687359 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 20:31:48.687359 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 20:31:48.687359 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 20:31:48.687359 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 20:31:48.688318 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 20:31:48.688318 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 20:31:48.688318 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 20:31:48.688318 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 20:31:48.688318 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:31:48.688318 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:31:48.688318 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:31:48.688318 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:31:48.688318 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:31:48.688318 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:31:48.688318 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:31:48.688318 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application with Lock( Oct 01 20:31:48.688318 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:31:48.688318 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:31:48.688318 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:31:48.688318 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:31:48.689192 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:31:48.689192 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:31:48.689192 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:31:48.689192 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:31:48.689192 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 20:31:48.689192 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 20:31:48.689192 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 20:31:48.689192 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 20:31:48.689192 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 20:31:48.689192 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 20:31:48.689192 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 20:31:48.689192 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:31:48.689192 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 7/14] 10.222.0.23 () {56 vars in 1096 bytes} [Sat Oct 1 20:31:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:31:48.694560 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dceff1-c1d6-44c8-ab32-c67b85f21d4e None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:31:48.735063 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0522692-2163-4ab9-8f89-141fb4c793db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:31:48.737257 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0522692-2163-4ab9-8f89-141fb4c793db None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:31:48.776338 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:31:48.794752 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dceff1-c1d6-44c8-ab32-c67b85f21d4e None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:31:48.829621 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2172dee-11a3-45fa-97ef-8e5b687e3ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:31:48.830801 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2172dee-11a3-45fa-97ef-8e5b687e3ed0 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:31:48.831222 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2172dee-11a3-45fa-97ef-8e5b687e3ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:31:48.831371 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2172dee-11a3-45fa-97ef-8e5b687e3ed0 None admin] PATH_INFO: `/v3/roles` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:31:48.832014 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2172dee-11a3-45fa-97ef-8e5b687e3ed0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:31:48.832314 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2172dee-11a3-45fa-97ef-8e5b687e3ed0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:31:48.832830 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:31:48.833883 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2172dee-11a3-45fa-97ef-8e5b687e3ed0 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:31:48.836640 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 8/15] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Oct 1 20:31:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 01 20:31:48.842173 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0522692-2163-4ab9-8f89-141fb4c793db None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:31:48.846809 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 8/16] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Oct 1 20:31:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 20:31:48.852290 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2172dee-11a3-45fa-97ef-8e5b687e3ed0 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:31:48.956443 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2172dee-11a3-45fa-97ef-8e5b687e3ed0 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:31:48.993810 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befe8fc4-e1f9-4f7a-932c-2a39f73097e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:31:48.994491 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe8fc4-e1f9-4f7a-932c-2a39f73097e1 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:31:48.994711 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe8fc4-e1f9-4f7a-932c-2a39f73097e1 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:31:48.994987 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe8fc4-e1f9-4f7a-932c-2a39f73097e1 None admin] PATH_INFO: `/v3/users/6d59f4f70f764f57b1d8cf05402fdf0e` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:31:48.996127 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befe8fc4-e1f9-4f7a-932c-2a39f73097e1 None admin] RBAC: Authorizing `identity:get_user(user_id=6d59f4f70f764f57b1d8cf05402fdf0e)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:31:48.997649 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befe8fc4-e1f9-4f7a-932c-2a39f73097e1 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:31:48.999372 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 9/17] 10.222.0.23 () {56 vars in 1177 bytes} [Sat Oct 1 20:31:48 2022] GET /identity/v3/users/6d59f4f70f764f57b1d8cf05402fdf0e => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 20:31:49.004581 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befe8fc4-e1f9-4f7a-932c-2a39f73097e1 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:31:49.021693 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:31:49.060190 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0522692-2163-4ab9-8f89-141fb4c793db None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:31:49.093604 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e646b97e-01b6-4488-a786-3bdabec88b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:31:49.094443 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646b97e-01b6-4488-a786-3bdabec88b43 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:31:49.094714 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646b97e-01b6-4488-a786-3bdabec88b43 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:31:49.094981 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646b97e-01b6-4488-a786-3bdabec88b43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:31:49.111888 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befe8fc4-e1f9-4f7a-932c-2a39f73097e1 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:31:49.113848 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e646b97e-01b6-4488-a786-3bdabec88b43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:31:49.115324 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e646b97e-01b6-4488-a786-3bdabec88b43 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:31:49.133621 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-e646b97e-01b6-4488-a786-3bdabec88b43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:31:49.133621 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:31:49.133621 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:31:49.133621 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:31:49.133621 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:31:49.133621 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:31:49.133621 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:31:49.133621 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:31:49.133621 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:31:49.133621 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:31:49.133621 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:31:49.133621 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:31:49.133621 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 20:31:49.133621 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 20:31:49.133621 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 20:31:49.133621 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 20:31:49.134663 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:31:49.134663 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:31:49.134663 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:31:49.134663 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:31:49.134663 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:31:49.134663 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:31:49.134663 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:31:49.134663 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:31:49.134663 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:31:49.134663 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:31:49.134663 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:31:49.134663 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:31:49.134663 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:31:49.134663 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:31:49.134663 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:31:49.134663 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:31:49.134663 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 20:31:49.135834 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 20:31:49.135834 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:31:49.135834 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:31:49.135834 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 9/18] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Oct 1 20:31:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 01 20:31:49.140427 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e646b97e-01b6-4488-a786-3bdabec88b43 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:31:49.147819 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dcca8a-4e19-406a-a9ea-8abb6535b250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:31:49.148447 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dcca8a-4e19-406a-a9ea-8abb6535b250 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:31:49.148758 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dcca8a-4e19-406a-a9ea-8abb6535b250 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:31:49.149024 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dcca8a-4e19-406a-a9ea-8abb6535b250 None admin] PATH_INFO: `/v3/domains/default` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:31:49.150123 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dcca8a-4e19-406a-a9ea-8abb6535b250 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:31:49.151582 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dcca8a-4e19-406a-a9ea-8abb6535b250 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:31:49.153128 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 10/19] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Oct 1 20:31:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 20:31:49.160909 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dcca8a-4e19-406a-a9ea-8abb6535b250 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:31:49.196179 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:31:49.241021 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:31:49.244249 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e646b97e-01b6-4488-a786-3bdabec88b43 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:31:49.260331 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dcca8a-4e19-406a-a9ea-8abb6535b250 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:31:49.277620 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3ca7e2-e42d-45f6-ad00-26dbcb534de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:31:49.278227 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ca7e2-e42d-45f6-ad00-26dbcb534de0 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:31:49.278515 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ca7e2-e42d-45f6-ad00-26dbcb534de0 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:31:49.278793 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ca7e2-e42d-45f6-ad00-26dbcb534de0 None admin] PATH_INFO: `/v3/domains` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:31:49.279439 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3ca7e2-e42d-45f6-ad00-26dbcb534de0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:31:49.279745 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3ca7e2-e42d-45f6-ad00-26dbcb534de0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:31:49.281175 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3ca7e2-e42d-45f6-ad00-26dbcb534de0 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:31:49.293601 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0135cafb-93a2-4192-bbb8-c2e9eae27c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:31:49.294199 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0135cafb-93a2-4192-bbb8-c2e9eae27c41 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:31:49.294473 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0135cafb-93a2-4192-bbb8-c2e9eae27c41 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:31:49.294741 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0135cafb-93a2-4192-bbb8-c2e9eae27c41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:31:49.295445 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0135cafb-93a2-4192-bbb8-c2e9eae27c41 None admin] RBAC: Adding query filter params (role.id=d11e7ba2f1fa41ff8ea8dda2a8d1466f, scope.domain.id=default, user.id=6d59f4f70f764f57b1d8cf05402fdf0e) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:31:49.295751 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0135cafb-93a2-4192-bbb8-c2e9eae27c41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:31:49.297202 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0135cafb-93a2-4192-bbb8-c2e9eae27c41 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:31:49.298556 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 10/20] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Oct 1 20:31:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 20:31:49.303974 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 11/21] 10.222.0.23 () {56 vars in 1322 bytes} [Sat Oct 1 20:31:49 2022] GET /identity/v3/role_assignments?user.id=6d59f4f70f764f57b1d8cf05402fdf0e&scope.domain.id=default&role.id=d11e7ba2f1fa41ff8ea8dda2a8d1466f => generated 233 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 20:31:52.500697 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d8d8b-ca4a-42fd-b643-8b61800ad21c None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:31:52.501745 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d8d8b-ca4a-42fd-b643-8b61800ad21c None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:31:52.502237 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d8d8b-ca4a-42fd-b643-8b61800ad21c None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:31:52.503858 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 11/22] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:31:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:31:52.509201 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f0ffb-80a0-4886-ae09-ee781bac2293 None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:31:52.510014 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f0ffb-80a0-4886-ae09-ee781bac2293 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:31:52.510535 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f0ffb-80a0-4886-ae09-ee781bac2293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:31:52.536615 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-558f0ffb-80a0-4886-ae09-ee781bac2293 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:31:52.538559 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-558f0ffb-80a0-4886-ae09-ee781bac2293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:31:52.560826 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223980f3-17d4-4185-9661-3befa7fb9eb9 None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:31:52.562414 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223980f3-17d4-4185-9661-3befa7fb9eb9 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:31:52.563203 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223980f3-17d4-4185-9661-3befa7fb9eb9 None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:31:52.564877 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 12/23] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:31:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 01 20:31:52.571888 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd94d1b-2440-4480-89be-90cac548f50b None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:31:52.572504 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd94d1b-2440-4480-89be-90cac548f50b None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:31:52.572995 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd94d1b-2440-4480-89be-90cac548f50b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:31:52.604621 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-1bd94d1b-2440-4480-89be-90cac548f50b None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:31:52.607918 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-1bd94d1b-2440-4480-89be-90cac548f50b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:31:52.720329 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 12/24] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:31:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 20:31:52.739126 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4cf838-d6ae-4a00-8a4c-74e037e89a18 None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:31:52.739734 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4cf838-d6ae-4a00-8a4c-74e037e89a18 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:31:52.740201 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4cf838-d6ae-4a00-8a4c-74e037e89a18 None None] PATH_INFO: `/` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:31:52.742043 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 13/25] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:31:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:31:52.746975 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514cfc94-36b7-4050-bce7-ec38f29c8e62 None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:31:52.747493 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514cfc94-36b7-4050-bce7-ec38f29c8e62 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:31:52.747955 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514cfc94-36b7-4050-bce7-ec38f29c8e62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:31:52.779715 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 13/26] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:31:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 01 20:31:52.781097 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-514cfc94-36b7-4050-bce7-ec38f29c8e62 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:31:52.782536 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-514cfc94-36b7-4050-bce7-ec38f29c8e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:31:52.879833 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 14/27] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:31:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 20:31:53.123370 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5af368-4681-4af9-82ef-d7f06a2ada08 None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:31:53.123706 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5af368-4681-4af9-82ef-d7f06a2ada08 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:31:53.123906 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5af368-4681-4af9-82ef-d7f06a2ada08 None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:31:53.125274 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 14/28] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:31:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:31:53.131244 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb56180-08de-4ea6-b46f-0bfc5ad704bd None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:31:53.131792 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb56180-08de-4ea6-b46f-0bfc5ad704bd None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:31:53.132256 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb56180-08de-4ea6-b46f-0bfc5ad704bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:31:53.144958 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:31:53.160735 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-1bb56180-08de-4ea6-b46f-0bfc5ad704bd None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:31:53.161942 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-1bb56180-08de-4ea6-b46f-0bfc5ad704bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:31:53.257346 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 15/29] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:31:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 20:31:53.273368 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5af368-4681-4af9-82ef-d7f06a2ada08 None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:31:53.337097 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb56180-08de-4ea6-b46f-0bfc5ad704bd None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:31:53.341093 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:31:53.436295 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5af368-4681-4af9-82ef-d7f06a2ada08 None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:31:53.493004 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b14ebc-4a53-43e4-a5db-3887169d5961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:31:53.493643 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b14ebc-4a53-43e4-a5db-3887169d5961 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:31:53.493921 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b14ebc-4a53-43e4-a5db-3887169d5961 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:31:53.494193 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b14ebc-4a53-43e4-a5db-3887169d5961 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:31:53.519308 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b14ebc-4a53-43e4-a5db-3887169d5961 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 20:31:53.530472 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-85b14ebc-4a53-43e4-a5db-3887169d5961 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 20:31:53.530472 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:31:53.530472 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:31:53.530472 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:31:53.530472 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:31:53.530472 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:31:53.530472 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:31:53.530472 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:31:53.530472 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:31:53.530472 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:31:53.530472 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:31:53.530472 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:31:53.530472 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 20:31:53.530472 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 20:31:53.530472 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 20:31:53.530472 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 20:31:53.531367 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 20:31:53.531367 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 20:31:53.531367 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 20:31:53.531367 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 20:31:53.531367 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:31:53.531367 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:31:53.531367 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:31:53.531367 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:31:53.531367 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:31:53.531367 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:31:53.531367 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:31:53.531367 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:31:53.531367 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:31:53.531367 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:31:53.531367 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:31:53.531367 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:31:53.532115 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:31:53.532115 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:31:53.532115 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:31:53.532115 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:31:53.532115 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 20:31:53.532115 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 20:31:53.532115 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 20:31:53.532115 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 20:31:53.532115 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 20:31:53.532115 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 20:31:53.532115 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 20:31:53.532115 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:31:53.537886 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 15/30] 10.222.0.23 () {56 vars in 1096 bytes} [Sat Oct 1 20:31:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:31:53.538720 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b14ebc-4a53-43e4-a5db-3887169d5961 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:31:53.588843 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb56180-08de-4ea6-b46f-0bfc5ad704bd None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:31:53.657241 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373fdaf8-deec-4089-a2e4-85e6078d6696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:31:53.658440 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373fdaf8-deec-4089-a2e4-85e6078d6696 None admin] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:31:53.658727 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373fdaf8-deec-4089-a2e4-85e6078d6696 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:31:53.658992 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373fdaf8-deec-4089-a2e4-85e6078d6696 None admin] PATH_INFO: `/v3/roles` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:31:53.659792 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373fdaf8-deec-4089-a2e4-85e6078d6696 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:31:53.661218 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373fdaf8-deec-4089-a2e4-85e6078d6696 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:31:53.661736 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b14ebc-4a53-43e4-a5db-3887169d5961 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:31:53.663268 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:31:53.668975 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:31:53.707340 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f95e5-c291-497e-a3bb-d4f8f8619d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:31:53.707963 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f95e5-c291-497e-a3bb-d4f8f8619d9d None admin] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:31:53.708246 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f95e5-c291-497e-a3bb-d4f8f8619d9d None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:31:53.708704 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f95e5-c291-497e-a3bb-d4f8f8619d9d None admin] PATH_INFO: `/v3/roles` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:31:53.709523 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05f95e5-c291-497e-a3bb-d4f8f8619d9d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:31:53.710979 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05f95e5-c291-497e-a3bb-d4f8f8619d9d None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:31:53.806865 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 16/31] 10.222.0.23 () {60 vars in 1131 bytes} [Sat Oct 1 20:31:53 2022] POST /identity/v3/roles => generated 219 bytes in 470 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 01 20:31:53.814068 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373fdaf8-deec-4089-a2e4-85e6078d6696 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:31:53.863840 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 16/32] 10.222.0.23 () {60 vars in 1131 bytes} [Sat Oct 1 20:31:53 2022] POST /identity/v3/roles => generated 225 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 20:31:53.865340 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f95e5-c291-497e-a3bb-d4f8f8619d9d None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:31:54.008696 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f95e5-c291-497e-a3bb-d4f8f8619d9d None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:31:54.053904 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23ca3db-eeb8-41eb-8ca0-e47abaff8f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:31:54.055006 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ca3db-eeb8-41eb-8ca0-e47abaff8f4d None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:31:54.055487 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ca3db-eeb8-41eb-8ca0-e47abaff8f4d None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:31:54.055982 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ca3db-eeb8-41eb-8ca0-e47abaff8f4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:31:54.071684 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23ca3db-eeb8-41eb-8ca0-e47abaff8f4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:31:54.074166 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23ca3db-eeb8-41eb-8ca0-e47abaff8f4d None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:31:54.082782 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373fdaf8-deec-4089-a2e4-85e6078d6696 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:31:54.093152 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-b23ca3db-eeb8-41eb-8ca0-e47abaff8f4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:31:54.093152 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:31:54.093152 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:31:54.093152 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:31:54.093152 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:31:54.093152 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:31:54.093152 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:31:54.093152 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:31:54.093152 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:31:54.093152 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:31:54.093152 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:31:54.093152 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:31:54.093152 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 20:31:54.093152 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 20:31:54.093152 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 20:31:54.093152 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 20:31:54.094071 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:31:54.094071 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:31:54.094071 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:31:54.094071 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:31:54.094071 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:31:54.094071 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:31:54.094071 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:31:54.094071 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:31:54.094071 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:31:54.094071 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:31:54.094071 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:31:54.094071 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:31:54.094071 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:31:54.094071 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:31:54.094071 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:31:54.094071 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:31:54.094071 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 20:31:54.094881 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 20:31:54.094881 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:31:54.094881 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:31:54.097355 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 17/33] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Oct 1 20:31:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:31:54.099220 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09602885-c221-42dc-be91-08da3a5fe9b1 None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:31:54.099743 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09602885-c221-42dc-be91-08da3a5fe9b1 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:31:54.100235 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09602885-c221-42dc-be91-08da3a5fe9b1 None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:31:54.101881 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 18/34] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:31:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:31:54.110228 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b0028a-2628-4a8f-8c0d-fd8b23f17942 None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:31:54.110539 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b0028a-2628-4a8f-8c0d-fd8b23f17942 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:31:54.112573 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b0028a-2628-4a8f-8c0d-fd8b23f17942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:31:54.145813 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-a3b0028a-2628-4a8f-8c0d-fd8b23f17942 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:31:54.147406 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-a3b0028a-2628-4a8f-8c0d-fd8b23f17942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:31:54.159160 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:31:54.162146 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35197fc0-cdf3-4e76-a6d3-4f7484792539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:31:54.163094 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35197fc0-cdf3-4e76-a6d3-4f7484792539 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:31:54.163595 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35197fc0-cdf3-4e76-a6d3-4f7484792539 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:31:54.164072 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35197fc0-cdf3-4e76-a6d3-4f7484792539 None admin] PATH_INFO: `/v3/roles` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:31:54.166546 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35197fc0-cdf3-4e76-a6d3-4f7484792539 None admin] RBAC: Adding query filter params (name=admin) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:31:54.167669 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35197fc0-cdf3-4e76-a6d3-4f7484792539 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:31:54.170697 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35197fc0-cdf3-4e76-a6d3-4f7484792539 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:31:54.188360 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 17/35] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Oct 1 20:31:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:31:54.188360 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35197fc0-cdf3-4e76-a6d3-4f7484792539 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:31:54.258635 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 19/36] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:31:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 20:31:54.259707 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b0028a-2628-4a8f-8c0d-fd8b23f17942 None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:31:54.274860 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:31:54.335320 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35197fc0-cdf3-4e76-a6d3-4f7484792539 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:31:54.377893 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881212c6-70e5-48e6-be8e-0854ed7be2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:31:54.378584 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881212c6-70e5-48e6-be8e-0854ed7be2b7 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:31:54.378759 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881212c6-70e5-48e6-be8e-0854ed7be2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:31:54.379032 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881212c6-70e5-48e6-be8e-0854ed7be2b7 None admin] PATH_INFO: `/v3/domains` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:31:54.379672 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881212c6-70e5-48e6-be8e-0854ed7be2b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:31:54.379969 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881212c6-70e5-48e6-be8e-0854ed7be2b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:31:54.381372 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881212c6-70e5-48e6-be8e-0854ed7be2b7 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:31:54.396797 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b0028a-2628-4a8f-8c0d-fd8b23f17942 None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:31:54.398878 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 18/37] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Oct 1 20:31:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:31:54.403532 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f257971-3356-4b97-9921-1da9c57bddd6 None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:31:54.403532 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f257971-3356-4b97-9921-1da9c57bddd6 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:31:54.403532 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f257971-3356-4b97-9921-1da9c57bddd6 None None] PATH_INFO: `/` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:31:54.403532 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 19/38] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:31:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:31:54.406650 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f257971-3356-4b97-9921-1da9c57bddd6 None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:31:54.442047 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28028c1f-c7f6-4246-9fd2-8bf458386caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:31:54.442679 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28028c1f-c7f6-4246-9fd2-8bf458386caa None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:31:54.442955 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28028c1f-c7f6-4246-9fd2-8bf458386caa None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:31:54.443222 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28028c1f-c7f6-4246-9fd2-8bf458386caa None admin] PATH_INFO: `/v3/users/6d59f4f70f764f57b1d8cf05402fdf0e` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:31:54.445137 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28028c1f-c7f6-4246-9fd2-8bf458386caa None admin] RBAC: Authorizing `identity:get_user(user_id=6d59f4f70f764f57b1d8cf05402fdf0e)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:31:54.446702 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28028c1f-c7f6-4246-9fd2-8bf458386caa None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:31:54.452641 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 20/39] 10.222.0.23 () {56 vars in 1177 bytes} [Sat Oct 1 20:31:54 2022] GET /identity/v3/users/6d59f4f70f764f57b1d8cf05402fdf0e => generated 247 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:31:54.452641 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32918f4-ad2d-4530-8927-dbc25ec9d6f5 None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:31:54.452641 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32918f4-ad2d-4530-8927-dbc25ec9d6f5 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:31:54.452641 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32918f4-ad2d-4530-8927-dbc25ec9d6f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:31:54.468475 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-d32918f4-ad2d-4530-8927-dbc25ec9d6f5 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:31:54.469782 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-d32918f4-ad2d-4530-8927-dbc25ec9d6f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:31:54.479133 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:31:54.516730 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f257971-3356-4b97-9921-1da9c57bddd6 None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:31:54.533560 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:31:54.546126 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 21/40] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:31:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 20:31:54.557026 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32918f4-ad2d-4530-8927-dbc25ec9d6f5 None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:31:54.557104 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fbe50f-3054-49e3-b31f-380e980b13ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:31:54.557104 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fbe50f-3054-49e3-b31f-380e980b13ed None admin] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:31:54.557104 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fbe50f-3054-49e3-b31f-380e980b13ed None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:31:54.557104 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fbe50f-3054-49e3-b31f-380e980b13ed None admin] PATH_INFO: `/v3/projects` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:31:54.557348 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fbe50f-3054-49e3-b31f-380e980b13ed None admin] RBAC: Authorizing `identity:create_project()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:31:54.557853 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fbe50f-3054-49e3-b31f-380e980b13ed None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:31:54.593038 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 20/41] 10.222.0.23 () {60 vars in 1141 bytes} [Sat Oct 1 20:31:54 2022] POST /identity/v3/projects => generated 301 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 20:31:54.613146 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fbe50f-3054-49e3-b31f-380e980b13ed None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:31:54.670129 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32918f4-ad2d-4530-8927-dbc25ec9d6f5 None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:31:54.711054 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf989b5-af1b-4039-bc0f-39aef9a5383c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:31:54.711710 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf989b5-af1b-4039-bc0f-39aef9a5383c None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:31:54.712016 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf989b5-af1b-4039-bc0f-39aef9a5383c None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:31:54.712560 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf989b5-af1b-4039-bc0f-39aef9a5383c None admin] PATH_INFO: `/v3/domains/default` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:31:54.714183 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf989b5-af1b-4039-bc0f-39aef9a5383c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:31:54.715690 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf989b5-af1b-4039-bc0f-39aef9a5383c None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:31:54.718344 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 22/42] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Oct 1 20:31:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:31:54.724986 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf989b5-af1b-4039-bc0f-39aef9a5383c None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:31:54.734581 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fbe50f-3054-49e3-b31f-380e980b13ed None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:31:54.745691 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:31:54.777664 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e138870-2ed2-4fe1-aff3-9673e47d8e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:31:54.778654 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e138870-2ed2-4fe1-aff3-9673e47d8e67 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:31:54.779282 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e138870-2ed2-4fe1-aff3-9673e47d8e67 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:31:54.779630 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e138870-2ed2-4fe1-aff3-9673e47d8e67 None admin] PATH_INFO: `/v3/domains/default` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:31:54.780996 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e138870-2ed2-4fe1-aff3-9673e47d8e67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:31:54.782739 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e138870-2ed2-4fe1-aff3-9673e47d8e67 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:31:54.785382 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 21/43] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Oct 1 20:31:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:31:54.791624 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e138870-2ed2-4fe1-aff3-9673e47d8e67 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:31:54.842900 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:31:54.864052 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf989b5-af1b-4039-bc0f-39aef9a5383c None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:31:54.919033 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3aed65-8abf-4fd4-86b3-8ab7e9601798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:31:54.919698 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3aed65-8abf-4fd4-86b3-8ab7e9601798 None admin] REQUEST_METHOD: `PUT` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:31:54.919975 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3aed65-8abf-4fd4-86b3-8ab7e9601798 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:31:54.920360 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3aed65-8abf-4fd4-86b3-8ab7e9601798 None admin] PATH_INFO: `/v3/domains/default/users/6d59f4f70f764f57b1d8cf05402fdf0e/roles/d11e7ba2f1fa41ff8ea8dda2a8d1466f` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:31:54.922274 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3aed65-8abf-4fd4-86b3-8ab7e9601798 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=6d59f4f70f764f57b1d8cf05402fdf0e, role_id=d11e7ba2f1fa41ff8ea8dda2a8d1466f)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:31:54.924367 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3aed65-8abf-4fd4-86b3-8ab7e9601798 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:31:54.930761 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e138870-2ed2-4fe1-aff3-9673e47d8e67 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:31:54.940270 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 23/44] 10.222.0.23 () {58 vars in 1361 bytes} [Sat Oct 1 20:31:54 2022] PUT /identity/v3/domains/default/users/6d59f4f70f764f57b1d8cf05402fdf0e/roles/d11e7ba2f1fa41ff8ea8dda2a8d1466f => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 01 20:31:54.941295 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3aed65-8abf-4fd4-86b3-8ab7e9601798 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:31:54.970480 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2623a5a-65ed-4ca8-90dc-913f7047b523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:31:54.971292 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2623a5a-65ed-4ca8-90dc-913f7047b523 None admin] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:31:54.971769 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2623a5a-65ed-4ca8-90dc-913f7047b523 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:31:54.972060 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2623a5a-65ed-4ca8-90dc-913f7047b523 None admin] PATH_INFO: `/v3/projects` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:31:54.972784 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2623a5a-65ed-4ca8-90dc-913f7047b523 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:31:54.974311 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2623a5a-65ed-4ca8-90dc-913f7047b523 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:31:55.008854 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 22/45] 10.222.0.23 () {60 vars in 1141 bytes} [Sat Oct 1 20:31:54 2022] POST /identity/v3/projects => generated 312 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 01 20:31:55.032850 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:31:55.072670 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3aed65-8abf-4fd4-86b3-8ab7e9601798 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:31:55.113239 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a630d72b-0319-4fcf-b0b8-c28deef2b606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:31:55.113879 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a630d72b-0319-4fcf-b0b8-c28deef2b606 None admin] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:31:55.114158 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a630d72b-0319-4fcf-b0b8-c28deef2b606 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:31:55.114431 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a630d72b-0319-4fcf-b0b8-c28deef2b606 None admin] PATH_INFO: `/v3/roles` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:31:55.115120 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a630d72b-0319-4fcf-b0b8-c28deef2b606 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:31:55.116578 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a630d72b-0319-4fcf-b0b8-c28deef2b606 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:31:55.134972 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 24/46] 10.222.0.23 () {60 vars in 1131 bytes} [Sat Oct 1 20:31:54 2022] POST /identity/v3/roles => generated 223 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 20:31:57.411362 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd785d2-a36e-41a1-853e-73dff41791f1 None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:31:57.411874 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd785d2-a36e-41a1-853e-73dff41791f1 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:31:57.411955 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd785d2-a36e-41a1-853e-73dff41791f1 None None] PATH_INFO: `/` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:31:57.413286 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 23/47] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:31:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:31:57.418504 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58920ab-352c-4721-821e-c8f8d41f8a2d None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:31:57.418928 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58920ab-352c-4721-821e-c8f8d41f8a2d None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:31:57.419054 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58920ab-352c-4721-821e-c8f8d41f8a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:31:57.437956 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-d58920ab-352c-4721-821e-c8f8d41f8a2d None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:31:57.439115 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-d58920ab-352c-4721-821e-c8f8d41f8a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:31:57.463492 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb7307b-c2f7-4cac-bcdd-4f199f3cdd6a None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:31:57.463788 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb7307b-c2f7-4cac-bcdd-4f199f3cdd6a None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:31:57.464066 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb7307b-c2f7-4cac-bcdd-4f199f3cdd6a None None] PATH_INFO: `/` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:31:57.465437 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 24/48] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:31:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:31:57.470824 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd38d47-7947-4a3f-b040-f6d00296aab0 None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:31:57.471107 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd38d47-7947-4a3f-b040-f6d00296aab0 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:31:57.471379 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd38d47-7947-4a3f-b040-f6d00296aab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:31:57.490023 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-6fd38d47-7947-4a3f-b040-f6d00296aab0 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:31:57.491516 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-6fd38d47-7947-4a3f-b040-f6d00296aab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:31:57.509582 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 25/49] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:31:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 01 20:31:57.557212 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 25/50] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:31:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 01 20:31:57.837136 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58920ab-352c-4721-821e-c8f8d41f8a2d None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:31:57.885432 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd38d47-7947-4a3f-b040-f6d00296aab0 None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:31:57.895896 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:31:57.905900 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:31:57.937865 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58920ab-352c-4721-821e-c8f8d41f8a2d None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:31:57.972060 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3dfeaf-30a1-4189-bc01-c382c3dfef7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:31:57.972724 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3dfeaf-30a1-4189-bc01-c382c3dfef7a None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:31:57.973008 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3dfeaf-30a1-4189-bc01-c382c3dfef7a None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:31:57.973285 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3dfeaf-30a1-4189-bc01-c382c3dfef7a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:31:57.983511 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3dfeaf-30a1-4189-bc01-c382c3dfef7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 20:31:57.987171 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd38d47-7947-4a3f-b040-f6d00296aab0 None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:31:57.989401 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-bb3dfeaf-30a1-4189-bc01-c382c3dfef7a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 20:31:57.989401 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:31:57.989401 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:31:57.989401 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:31:57.989401 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:31:57.989401 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:31:57.989401 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:31:57.989401 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:31:57.989401 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:31:57.989401 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:31:57.989401 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:31:57.989401 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:31:57.989401 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 20:31:57.989401 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 20:31:57.989401 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 20:31:57.989401 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 20:31:57.990394 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 20:31:57.990394 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 20:31:57.990394 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 20:31:57.990394 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 20:31:57.990394 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:31:57.990394 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:31:57.990394 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:31:57.990394 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:31:57.990394 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:31:57.990394 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:31:57.990394 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:31:57.990394 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:31:57.990394 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:31:57.990394 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:31:57.990394 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:31:57.990394 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:31:57.991171 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:31:57.991171 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:31:57.991171 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:31:57.991171 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:31:57.991171 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 20:31:57.991171 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 20:31:57.991171 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 20:31:57.991171 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 20:31:57.991171 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 20:31:57.991171 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 20:31:57.991171 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 20:31:57.991171 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:31:57.991171 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 26/51] 10.222.0.23 () {56 vars in 1096 bytes} [Sat Oct 1 20:31:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:31:57.996196 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3dfeaf-30a1-4189-bc01-c382c3dfef7a None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:31:58.022728 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2514027-1b83-435d-beb2-9b01b42c6c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:31:58.023353 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2514027-1b83-435d-beb2-9b01b42c6c2b None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:31:58.023632 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2514027-1b83-435d-beb2-9b01b42c6c2b None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:31:58.023903 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2514027-1b83-435d-beb2-9b01b42c6c2b None admin] PATH_INFO: `/v3/domains/default` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:31:58.025019 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2514027-1b83-435d-beb2-9b01b42c6c2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:31:58.026479 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2514027-1b83-435d-beb2-9b01b42c6c2b None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:31:58.028028 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 26/52] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Oct 1 20:31:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 20:31:58.033612 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2514027-1b83-435d-beb2-9b01b42c6c2b None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:31:58.096395 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3dfeaf-30a1-4189-bc01-c382c3dfef7a None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:31:58.116585 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:31:58.116796 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:31:58.132007 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256e8c39-45ec-450e-a721-6658669325bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:31:58.132641 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e8c39-45ec-450e-a721-6658669325bb None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:31:58.132776 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2514027-1b83-435d-beb2-9b01b42c6c2b None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:31:58.132927 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e8c39-45ec-450e-a721-6658669325bb None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:31:58.133204 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e8c39-45ec-450e-a721-6658669325bb None admin] PATH_INFO: `/v3/roles` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:31:58.133873 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256e8c39-45ec-450e-a721-6658669325bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:31:58.134182 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256e8c39-45ec-450e-a721-6658669325bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:31:58.135577 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256e8c39-45ec-450e-a721-6658669325bb None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:31:58.147781 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 27/53] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Oct 1 20:31:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 20:31:58.153124 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256e8c39-45ec-450e-a721-6658669325bb None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:31:58.167374 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2b6361-8ebb-46b2-99af-a77de9248b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:31:58.168198 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b6361-8ebb-46b2-99af-a77de9248b70 None admin] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:31:58.168479 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b6361-8ebb-46b2-99af-a77de9248b70 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:31:58.168790 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b6361-8ebb-46b2-99af-a77de9248b70 None admin] PATH_INFO: `/v3/projects` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:31:58.169441 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2b6361-8ebb-46b2-99af-a77de9248b70 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:31:58.170906 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2b6361-8ebb-46b2-99af-a77de9248b70 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:31:58.198982 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 27/54] 10.222.0.23 () {60 vars in 1140 bytes} [Sat Oct 1 20:31:58 2022] POST /identity/v3/projects => generated 298 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 01 20:31:58.268203 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256e8c39-45ec-450e-a721-6658669325bb None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:31:58.304132 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf31903-eff7-4d2f-a5eb-d7a085c2b2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:31:58.304806 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf31903-eff7-4d2f-a5eb-d7a085c2b2fa None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:31:58.305089 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf31903-eff7-4d2f-a5eb-d7a085c2b2fa None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:31:58.305369 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf31903-eff7-4d2f-a5eb-d7a085c2b2fa None admin] PATH_INFO: `/v3/users/6d59f4f70f764f57b1d8cf05402fdf0e` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:31:58.306548 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf31903-eff7-4d2f-a5eb-d7a085c2b2fa None admin] RBAC: Authorizing `identity:get_user(user_id=6d59f4f70f764f57b1d8cf05402fdf0e)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:31:58.308038 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf31903-eff7-4d2f-a5eb-d7a085c2b2fa None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:31:58.309741 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 28/55] 10.222.0.23 () {56 vars in 1177 bytes} [Sat Oct 1 20:31:58 2022] GET /identity/v3/users/6d59f4f70f764f57b1d8cf05402fdf0e => generated 247 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 20:31:58.316107 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2b6361-8ebb-46b2-99af-a77de9248b70 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:31:58.421355 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2b6361-8ebb-46b2-99af-a77de9248b70 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:31:58.460118 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f526e27f-f9b2-4ad3-89c9-239c1367d4d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:31:58.460784 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f526e27f-f9b2-4ad3-89c9-239c1367d4d1 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:31:58.461069 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f526e27f-f9b2-4ad3-89c9-239c1367d4d1 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:31:58.461345 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f526e27f-f9b2-4ad3-89c9-239c1367d4d1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:31:58.462449 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f526e27f-f9b2-4ad3-89c9-239c1367d4d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:31:58.463904 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f526e27f-f9b2-4ad3-89c9-239c1367d4d1 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:31:58.465507 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 28/56] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Oct 1 20:31:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:31:58.472080 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf31903-eff7-4d2f-a5eb-d7a085c2b2fa None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:31:58.521935 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:31:58.571420 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf31903-eff7-4d2f-a5eb-d7a085c2b2fa None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:31:58.604854 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2afe6c-36ca-4197-a5e9-b49834346e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:31:58.605463 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2afe6c-36ca-4197-a5e9-b49834346e87 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:31:58.605746 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2afe6c-36ca-4197-a5e9-b49834346e87 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:31:58.606021 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2afe6c-36ca-4197-a5e9-b49834346e87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:31:58.606737 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2afe6c-36ca-4197-a5e9-b49834346e87 None admin] RBAC: Adding query filter params (role.id=d11e7ba2f1fa41ff8ea8dda2a8d1466f, scope.domain.id=default, user.id=6d59f4f70f764f57b1d8cf05402fdf0e) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:31:58.607045 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2afe6c-36ca-4197-a5e9-b49834346e87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:31:58.608506 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2afe6c-36ca-4197-a5e9-b49834346e87 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:31:58.617633 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 29/57] 10.222.0.23 () {56 vars in 1322 bytes} [Sat Oct 1 20:31:58 2022] GET /identity/v3/role_assignments?user.id=6d59f4f70f764f57b1d8cf05402fdf0e&scope.domain.id=default&role.id=d11e7ba2f1fa41ff8ea8dda2a8d1466f => generated 530 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 20:32:00.621412 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c432d-e7e8-4e06-8044-6ecab4299dbb None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:00.621987 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c432d-e7e8-4e06-8044-6ecab4299dbb None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:00.621987 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c432d-e7e8-4e06-8044-6ecab4299dbb None None] PATH_INFO: `/` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:00.623301 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 29/58] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:32:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:32:00.628417 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8579df2-7626-4cc1-acae-ea8bd5251f75 None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:00.628857 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8579df2-7626-4cc1-acae-ea8bd5251f75 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:00.629016 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8579df2-7626-4cc1-acae-ea8bd5251f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:00.647773 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-c8579df2-7626-4cc1-acae-ea8bd5251f75 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:32:00.648999 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-c8579df2-7626-4cc1-acae-ea8bd5251f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:32:00.714518 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 30/59] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:32:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 20:32:01.036117 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5c432d-e7e8-4e06-8044-6ecab4299dbb None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:01.045273 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:01.134872 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5c432d-e7e8-4e06-8044-6ecab4299dbb None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:01.166698 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223292d3-86de-430f-9ae9-2dc42179ce47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:01.167325 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223292d3-86de-430f-9ae9-2dc42179ce47 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:01.167607 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223292d3-86de-430f-9ae9-2dc42179ce47 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:01.167881 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223292d3-86de-430f-9ae9-2dc42179ce47 None admin] PATH_INFO: `/v3/domains/default` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:01.169021 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223292d3-86de-430f-9ae9-2dc42179ce47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:01.170476 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223292d3-86de-430f-9ae9-2dc42179ce47 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:01.172052 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 30/60] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Oct 1 20:32:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:01.178059 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8579df2-7626-4cc1-acae-ea8bd5251f75 None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:01.221421 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:01.273878 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8579df2-7626-4cc1-acae-ea8bd5251f75 None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:01.313231 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06472dd8-6cd0-4696-9717-bde59f3e080e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:01.313859 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06472dd8-6cd0-4696-9717-bde59f3e080e None admin] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:01.314372 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06472dd8-6cd0-4696-9717-bde59f3e080e None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:01.314809 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06472dd8-6cd0-4696-9717-bde59f3e080e None admin] PATH_INFO: `/v3/users` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:01.315832 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06472dd8-6cd0-4696-9717-bde59f3e080e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:01.317469 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06472dd8-6cd0-4696-9717-bde59f3e080e None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:01.344053 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 31/61] 10.222.0.23 () {60 vars in 1132 bytes} [Sat Oct 1 20:32:01 2022] POST /identity/v3/users => generated 275 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 01 20:32:04.904541 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1367bf-816f-4159-83ab-0104c5fb545f None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:04.904541 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1367bf-816f-4159-83ab-0104c5fb545f None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:04.904541 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1367bf-816f-4159-83ab-0104c5fb545f None None] PATH_INFO: `/` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:04.905708 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 31/62] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:32:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:32:04.909736 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b997eed8-0d44-4fcf-9e36-d000ee7dbb4a None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:04.910154 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b997eed8-0d44-4fcf-9e36-d000ee7dbb4a None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:04.910322 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b997eed8-0d44-4fcf-9e36-d000ee7dbb4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:04.937848 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-b997eed8-0d44-4fcf-9e36-d000ee7dbb4a None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:32:04.939627 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-b997eed8-0d44-4fcf-9e36-d000ee7dbb4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:32:05.027076 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 32/63] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:32:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 20:32:05.036412 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fba3bd2-c81c-4d8a-a1b1-0d25d74cc4a4 None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:05.037031 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fba3bd2-c81c-4d8a-a1b1-0d25d74cc4a4 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:05.037519 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fba3bd2-c81c-4d8a-a1b1-0d25d74cc4a4 None None] PATH_INFO: `/` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:05.040037 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 32/64] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:32:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:32:05.044691 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c620c9-e17f-4893-956f-4ff27ff8303b None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:05.044977 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c620c9-e17f-4893-956f-4ff27ff8303b None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:05.045253 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c620c9-e17f-4893-956f-4ff27ff8303b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:05.065350 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-53c620c9-e17f-4893-956f-4ff27ff8303b None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:32:05.066603 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-53c620c9-e17f-4893-956f-4ff27ff8303b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:32:05.091336 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:05.155064 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 33/65] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:32:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 20:32:05.401033 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fba3bd2-c81c-4d8a-a1b1-0d25d74cc4a4 None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:05.498708 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:05.535237 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fba3bd2-c81c-4d8a-a1b1-0d25d74cc4a4 None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:05.580946 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7757bfa8-fdf0-49b6-b99f-4ceaf49ef58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:05.581581 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7757bfa8-fdf0-49b6-b99f-4ceaf49ef58d None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:05.581860 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7757bfa8-fdf0-49b6-b99f-4ceaf49ef58d None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:05.582130 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7757bfa8-fdf0-49b6-b99f-4ceaf49ef58d None admin] PATH_INFO: `/v3/roles/member` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:05.596076 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7757bfa8-fdf0-49b6-b99f-4ceaf49ef58d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 20:32:05.604980 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application [None req-7757bfa8-fdf0-49b6-b99f-4ceaf49ef58d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 01 20:32:05.604980 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:32:05.604980 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:32:05.604980 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:32:05.604980 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:32:05.604980 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:32:05.604980 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:32:05.604980 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:32:05.604980 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:32:05.604980 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:32:05.604980 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:32:05.604980 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:32:05.604980 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 20:32:05.604980 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 20:32:05.604980 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 20:32:05.604980 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 20:32:05.605922 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 20:32:05.605922 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 20:32:05.605922 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 20:32:05.605922 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 20:32:05.605922 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:32:05.605922 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:32:05.605922 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:32:05.605922 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:32:05.605922 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:32:05.605922 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:32:05.605922 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:32:05.605922 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application with Lock( Oct 01 20:32:05.605922 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:32:05.605922 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:32:05.605922 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:32:05.605922 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:32:05.606717 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:32:05.606717 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:32:05.606717 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:32:05.606717 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:32:05.606717 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 20:32:05.606717 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 20:32:05.606717 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 20:32:05.606717 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 20:32:05.606717 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 20:32:05.606717 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 20:32:05.606717 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 01 20:32:05.606717 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:32:05.606717 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 33/66] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Oct 1 20:32:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:32:05.614171 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c620c9-e17f-4893-956f-4ff27ff8303b None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:05.623079 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7757bfa8-fdf0-49b6-b99f-4ceaf49ef58d None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:05.736331 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c620c9-e17f-4893-956f-4ff27ff8303b None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:05.752289 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7757bfa8-fdf0-49b6-b99f-4ceaf49ef58d None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:05.771289 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746f1ab7-2b62-4a97-b99a-afc5fb82b4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:05.771895 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746f1ab7-2b62-4a97-b99a-afc5fb82b4bf None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:05.772171 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746f1ab7-2b62-4a97-b99a-afc5fb82b4bf None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:05.772437 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746f1ab7-2b62-4a97-b99a-afc5fb82b4bf None admin] PATH_INFO: `/v3/roles` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:05.773122 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746f1ab7-2b62-4a97-b99a-afc5fb82b4bf None admin] RBAC: Adding query filter params (name=member) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:32:05.773424 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746f1ab7-2b62-4a97-b99a-afc5fb82b4bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:05.774785 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746f1ab7-2b62-4a97-b99a-afc5fb82b4bf None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:05.783639 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 34/67] 10.222.0.23 () {56 vars in 1101 bytes} [Sat Oct 1 20:32:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:05.784946 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1566feb7-ae6c-4b37-8d4e-d1322bc0ee97 None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:05.785288 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1566feb7-ae6c-4b37-8d4e-d1322bc0ee97 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:05.785508 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1566feb7-ae6c-4b37-8d4e-d1322bc0ee97 None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:05.786929 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 35/68] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:32:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:32:05.787786 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d62ce4-df33-4763-8910-12a7791a78ef None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:05.788068 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d62ce4-df33-4763-8910-12a7791a78ef None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:05.788341 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d62ce4-df33-4763-8910-12a7791a78ef None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:05.789464 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f524ba-16c4-41b0-9d80-9d15ef071c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:05.789611 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 36/69] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:32:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:32:05.790113 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f524ba-16c4-41b0-9d80-9d15ef071c51 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:05.790400 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f524ba-16c4-41b0-9d80-9d15ef071c51 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:05.790617 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a0e92e-66a5-4451-9df0-60e5e13cfde3 None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:05.790710 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f524ba-16c4-41b0-9d80-9d15ef071c51 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:05.791261 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a0e92e-66a5-4451-9df0-60e5e13cfde3 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:05.791261 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a0e92e-66a5-4451-9df0-60e5e13cfde3 None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:05.792278 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 37/70] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:32:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:32:05.793002 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a0e92e-66a5-4451-9df0-60e5e13cfde3 None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:05.796803 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:05.807378 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f524ba-16c4-41b0-9d80-9d15ef071c51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 20:32:05.812714 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application [None req-75f524ba-16c4-41b0-9d80-9d15ef071c51 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 20:32:05.812714 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:32:05.812714 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:32:05.812714 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:32:05.812714 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:32:05.812714 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:32:05.812714 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:32:05.812714 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:32:05.812714 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:32:05.812714 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:32:05.812714 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:32:05.812714 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:32:05.812714 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 20:32:05.812714 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 20:32:05.812714 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 20:32:05.812714 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 20:32:05.814098 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 20:32:05.814098 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 20:32:05.814098 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 20:32:05.814098 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 20:32:05.814098 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:32:05.814098 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:32:05.814098 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:32:05.814098 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:32:05.814098 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:32:05.814098 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:32:05.814098 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:32:05.814098 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application with Lock( Oct 01 20:32:05.814098 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:32:05.814098 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:32:05.814098 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:32:05.814098 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:32:05.814929 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:32:05.814929 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:32:05.814929 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:32:05.814929 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:32:05.814929 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 20:32:05.814929 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 20:32:05.814929 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 20:32:05.814929 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 20:32:05.814929 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 20:32:05.814929 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 20:32:05.814929 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 20:32:05.814929 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:32:05.814929 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 34/71] 10.222.0.23 () {56 vars in 1096 bytes} [Sat Oct 1 20:32:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:32:05.815908 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee98e53-7798-459a-883b-ab92a8c8f8f4 None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:05.816035 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee98e53-7798-459a-883b-ab92a8c8f8f4 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:05.816275 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee98e53-7798-459a-883b-ab92a8c8f8f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:05.820516 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:05.834166 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-2ee98e53-7798-459a-883b-ab92a8c8f8f4 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:32:05.835361 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-2ee98e53-7798-459a-883b-ab92a8c8f8f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:32:05.898758 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a0e92e-66a5-4451-9df0-60e5e13cfde3 None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:05.902012 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 35/72] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:32:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 20:32:05.903335 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f9616-c7e2-449a-ab0d-5c1c9cb9b239 None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:05.903632 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f9616-c7e2-449a-ab0d-5c1c9cb9b239 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:05.903944 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f9616-c7e2-449a-ab0d-5c1c9cb9b239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:05.922243 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-f57f9616-c7e2-449a-ab0d-5c1c9cb9b239 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:32:05.924331 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-f57f9616-c7e2-449a-ab0d-5c1c9cb9b239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:32:05.936777 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c8b6b8-60ba-46ad-9fae-71864f1582db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:05.937413 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c8b6b8-60ba-46ad-9fae-71864f1582db None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:05.937742 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c8b6b8-60ba-46ad-9fae-71864f1582db None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:05.938019 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c8b6b8-60ba-46ad-9fae-71864f1582db None admin] PATH_INFO: `/v3/users/b209a483d1084566a09bb6c4ec92134f` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:05.954251 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c8b6b8-60ba-46ad-9fae-71864f1582db None admin] RBAC: Authorizing `identity:get_user(user_id=b209a483d1084566a09bb6c4ec92134f)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:05.955711 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c8b6b8-60ba-46ad-9fae-71864f1582db None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:05.961672 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 38/73] 10.222.0.23 () {56 vars in 1177 bytes} [Sat Oct 1 20:32:05 2022] GET /identity/v3/users/b209a483d1084566a09bb6c4ec92134f => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:05.961672 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92814fc-4286-44f8-bf38-93f339442f49 None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:05.961672 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92814fc-4286-44f8-bf38-93f339442f49 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:05.961672 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92814fc-4286-44f8-bf38-93f339442f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:05.977952 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-c92814fc-4286-44f8-bf38-93f339442f49 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:32:05.979233 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-c92814fc-4286-44f8-bf38-93f339442f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:32:06.012633 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 36/74] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:32:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 20:32:06.012633 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57f9616-c7e2-449a-ab0d-5c1c9cb9b239 None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:06.065346 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 39/75] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:32:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 20:32:06.066770 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92814fc-4286-44f8-bf38-93f339442f49 None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:06.076813 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:06.087060 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:06.182533 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57f9616-c7e2-449a-ab0d-5c1c9cb9b239 None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:06.243234 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fd2505-0720-4812-86d7-52003d3a89f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:06.243841 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd2505-0720-4812-86d7-52003d3a89f0 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:06.244118 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd2505-0720-4812-86d7-52003d3a89f0 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:06.244386 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd2505-0720-4812-86d7-52003d3a89f0 None admin] PATH_INFO: `/v3/roles` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:06.245076 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fd2505-0720-4812-86d7-52003d3a89f0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:32:06.245375 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fd2505-0720-4812-86d7-52003d3a89f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:06.246760 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fd2505-0720-4812-86d7-52003d3a89f0 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:06.253683 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92814fc-4286-44f8-bf38-93f339442f49 None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:06.255972 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 37/76] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Oct 1 20:32:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:06.257019 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fd2505-0720-4812-86d7-52003d3a89f0 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:06.305322 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f917e29f-5071-461c-b00f-b97b9ced0207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:06.305871 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917e29f-5071-461c-b00f-b97b9ced0207 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:06.306145 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917e29f-5071-461c-b00f-b97b9ced0207 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:06.306415 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917e29f-5071-461c-b00f-b97b9ced0207 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:06.371612 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fd2505-0720-4812-86d7-52003d3a89f0 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:06.387236 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f917e29f-5071-461c-b00f-b97b9ced0207 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:06.388230 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:06.388756 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f917e29f-5071-461c-b00f-b97b9ced0207 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:06.402680 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:06.409478 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fce98e5-36e3-40b8-a093-254c05fbfeab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:06.410114 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce98e5-36e3-40b8-a093-254c05fbfeab None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:06.410400 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce98e5-36e3-40b8-a093-254c05fbfeab None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:06.410866 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce98e5-36e3-40b8-a093-254c05fbfeab None admin] PATH_INFO: `/v3/domains/default` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:06.411807 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fce98e5-36e3-40b8-a093-254c05fbfeab None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:06.413293 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fce98e5-36e3-40b8-a093-254c05fbfeab None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:06.416707 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 38/77] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Oct 1 20:32:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:06.416707 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fce98e5-36e3-40b8-a093-254c05fbfeab None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:06.496440 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 40/78] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Oct 1 20:32:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 01 20:32:06.497326 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f917e29f-5071-461c-b00f-b97b9ced0207 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:06.521898 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fce98e5-36e3-40b8-a093-254c05fbfeab None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:06.556696 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb44cafe-ca28-4959-85f0-f8b02e9d3c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:06.557250 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb44cafe-ca28-4959-85f0-f8b02e9d3c95 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:06.557535 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb44cafe-ca28-4959-85f0-f8b02e9d3c95 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:06.557811 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb44cafe-ca28-4959-85f0-f8b02e9d3c95 None admin] PATH_INFO: `/v3/users/6d59f4f70f764f57b1d8cf05402fdf0e` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:06.558954 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb44cafe-ca28-4959-85f0-f8b02e9d3c95 None admin] RBAC: Authorizing `identity:get_user(user_id=6d59f4f70f764f57b1d8cf05402fdf0e)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:06.560425 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb44cafe-ca28-4959-85f0-f8b02e9d3c95 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:06.562202 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 39/79] 10.222.0.23 () {56 vars in 1177 bytes} [Sat Oct 1 20:32:06 2022] GET /identity/v3/users/6d59f4f70f764f57b1d8cf05402fdf0e => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:06.562763 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb44cafe-ca28-4959-85f0-f8b02e9d3c95 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:06.597468 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f917e29f-5071-461c-b00f-b97b9ced0207 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:06.607526 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:06.614710 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:06.632827 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64199775-ce89-4872-8d01-e775aa7e4220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:06.633453 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64199775-ce89-4872-8d01-e775aa7e4220 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:06.633735 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64199775-ce89-4872-8d01-e775aa7e4220 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:06.634009 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64199775-ce89-4872-8d01-e775aa7e4220 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:06.644696 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64199775-ce89-4872-8d01-e775aa7e4220 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 20:32:06.649935 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-64199775-ce89-4872-8d01-e775aa7e4220 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 01 20:32:06.649935 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:32:06.649935 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:32:06.649935 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:32:06.649935 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:32:06.649935 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:32:06.649935 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:32:06.649935 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:32:06.649935 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:32:06.649935 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:32:06.649935 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:32:06.649935 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:32:06.649935 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 20:32:06.649935 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 20:32:06.649935 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 20:32:06.649935 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 20:32:06.650863 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 20:32:06.650863 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 20:32:06.650863 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 20:32:06.650863 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 20:32:06.650863 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:32:06.650863 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:32:06.650863 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:32:06.650863 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:32:06.650863 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:32:06.650863 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:32:06.650863 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:32:06.650863 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:32:06.650863 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:32:06.650863 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:32:06.650863 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:32:06.650863 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:32:06.651710 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:32:06.651710 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:32:06.651710 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:32:06.651710 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:32:06.651710 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 20:32:06.651710 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 20:32:06.651710 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 20:32:06.651710 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 20:32:06.651710 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 20:32:06.651710 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 20:32:06.651710 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 01 20:32:06.651710 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:32:06.651710 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 41/80] 10.222.0.23 () {56 vars in 1114 bytes} [Sat Oct 1 20:32:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:32:06.652329 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64199775-ce89-4872-8d01-e775aa7e4220 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:06.665374 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb44cafe-ca28-4959-85f0-f8b02e9d3c95 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:06.700742 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c36528-cd7d-4ea4-979b-16c4905598ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:06.701342 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c36528-cd7d-4ea4-979b-16c4905598ea None admin] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:06.701617 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c36528-cd7d-4ea4-979b-16c4905598ea None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:06.701884 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c36528-cd7d-4ea4-979b-16c4905598ea None admin] PATH_INFO: `/v3/users` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:06.702552 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c36528-cd7d-4ea4-979b-16c4905598ea None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:06.704016 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c36528-cd7d-4ea4-979b-16c4905598ea None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:06.730678 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 40/81] 10.222.0.23 () {60 vars in 1132 bytes} [Sat Oct 1 20:32:06 2022] POST /identity/v3/users => generated 289 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 20:32:06.731499 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c36528-cd7d-4ea4-979b-16c4905598ea None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:06.764450 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64199775-ce89-4872-8d01-e775aa7e4220 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:06.805511 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c453c526-97dc-4c8b-82a3-9be5db2570e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:06.806170 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c453c526-97dc-4c8b-82a3-9be5db2570e9 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:06.806454 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c453c526-97dc-4c8b-82a3-9be5db2570e9 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:06.806789 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c453c526-97dc-4c8b-82a3-9be5db2570e9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:06.819883 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c453c526-97dc-4c8b-82a3-9be5db2570e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 20:32:06.825456 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-c453c526-97dc-4c8b-82a3-9be5db2570e9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 01 20:32:06.825456 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:32:06.825456 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:32:06.825456 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:32:06.825456 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:32:06.825456 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:32:06.825456 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:32:06.825456 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:32:06.825456 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:32:06.825456 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:32:06.825456 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:32:06.825456 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:32:06.825456 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 20:32:06.825456 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 20:32:06.825456 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 20:32:06.825456 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 20:32:06.826516 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 20:32:06.826516 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 20:32:06.826516 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 20:32:06.826516 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 20:32:06.826516 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:32:06.826516 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:32:06.826516 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:32:06.826516 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:32:06.826516 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:32:06.826516 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:32:06.826516 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:32:06.826516 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:32:06.826516 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:32:06.826516 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:32:06.826516 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:32:06.826516 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:32:06.827401 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:32:06.827401 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:32:06.827401 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:32:06.827401 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:32:06.827401 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 20:32:06.827401 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 20:32:06.827401 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 20:32:06.827401 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 20:32:06.827401 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 20:32:06.827401 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 20:32:06.827401 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 01 20:32:06.827401 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:32:06.827401 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 42/82] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Oct 1 20:32:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:32:06.829669 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c453c526-97dc-4c8b-82a3-9be5db2570e9 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:06.856794 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c36528-cd7d-4ea4-979b-16c4905598ea None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:06.868472 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:06.870204 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:06.901074 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb5b4ae-cd1c-4830-a06c-8f776b96e91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:06.901730 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb5b4ae-cd1c-4830-a06c-8f776b96e91c None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:06.902016 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb5b4ae-cd1c-4830-a06c-8f776b96e91c None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:06.902297 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb5b4ae-cd1c-4830-a06c-8f776b96e91c None admin] PATH_INFO: `/v3/projects/754d04e2573f4c81b21775be5d8d103e` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:06.903479 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb5b4ae-cd1c-4830-a06c-8f776b96e91c None admin] RBAC: Authorizing `identity:get_project(project_id=754d04e2573f4c81b21775be5d8d103e)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:06.905030 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb5b4ae-cd1c-4830-a06c-8f776b96e91c None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:06.906814 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 41/83] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Oct 1 20:32:06 2022] GET /identity/v3/projects/754d04e2573f4c81b21775be5d8d103e => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:06.908574 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb5b4ae-cd1c-4830-a06c-8f776b96e91c None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:06.956063 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c453c526-97dc-4c8b-82a3-9be5db2570e9 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:06.996698 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1b6057-88dd-4a5f-a276-e9ade5954752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:06.997319 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b6057-88dd-4a5f-a276-e9ade5954752 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:06.997606 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b6057-88dd-4a5f-a276-e9ade5954752 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:06.997890 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b6057-88dd-4a5f-a276-e9ade5954752 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:07.030777 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb5b4ae-cd1c-4830-a06c-8f776b96e91c None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:07.073781 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88054634-e295-41c7-aefa-ac27aacee5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:07.074761 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88054634-e295-41c7-aefa-ac27aacee5b2 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:07.075181 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88054634-e295-41c7-aefa-ac27aacee5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:07.075607 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88054634-e295-41c7-aefa-ac27aacee5b2 None admin] PATH_INFO: `/v3/roles` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:07.076923 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88054634-e295-41c7-aefa-ac27aacee5b2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:32:07.077370 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88054634-e295-41c7-aefa-ac27aacee5b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:07.078497 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1b6057-88dd-4a5f-a276-e9ade5954752 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:07.079979 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88054634-e295-41c7-aefa-ac27aacee5b2 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:07.081171 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1b6057-88dd-4a5f-a276-e9ade5954752 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:07.099696 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 42/84] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Oct 1 20:32:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:07.100361 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88054634-e295-41c7-aefa-ac27aacee5b2 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:07.122583 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:07.156968 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:07.209264 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 43/85] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Oct 1 20:32:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 01 20:32:07.210157 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1b6057-88dd-4a5f-a276-e9ade5954752 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:07.238678 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88054634-e295-41c7-aefa-ac27aacee5b2 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:07.292027 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05a98c1-75a4-4969-b81e-531d066df7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:07.292693 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05a98c1-75a4-4969-b81e-531d066df7f3 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:07.293073 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05a98c1-75a4-4969-b81e-531d066df7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:07.293358 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05a98c1-75a4-4969-b81e-531d066df7f3 None admin] PATH_INFO: `/v3/roles` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:07.294029 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05a98c1-75a4-4969-b81e-531d066df7f3 None admin] RBAC: Adding query filter params (name=member) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:32:07.294399 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05a98c1-75a4-4969-b81e-531d066df7f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:07.295959 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05a98c1-75a4-4969-b81e-531d066df7f3 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:07.305993 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 43/86] 10.222.0.23 () {56 vars in 1101 bytes} [Sat Oct 1 20:32:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:07.306905 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05a98c1-75a4-4969-b81e-531d066df7f3 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:07.342697 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1b6057-88dd-4a5f-a276-e9ade5954752 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:07.377361 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:07.385025 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c6f88f-147d-4ca5-abce-9c2a0e834760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:07.385861 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c6f88f-147d-4ca5-abce-9c2a0e834760 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:07.386241 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c6f88f-147d-4ca5-abce-9c2a0e834760 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:07.386665 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c6f88f-147d-4ca5-abce-9c2a0e834760 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:07.387589 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c6f88f-147d-4ca5-abce-9c2a0e834760 None admin] RBAC: Adding query filter params (role.id=82138515a02147ccb30f8d56863aab87, scope.project.id=754d04e2573f4c81b21775be5d8d103e, user.id=b209a483d1084566a09bb6c4ec92134f) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:32:07.387998 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c6f88f-147d-4ca5-abce-9c2a0e834760 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:07.389952 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c6f88f-147d-4ca5-abce-9c2a0e834760 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:07.397706 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 44/87] 10.222.0.23 () {56 vars in 1374 bytes} [Sat Oct 1 20:32:07 2022] GET /identity/v3/role_assignments?user.id=b209a483d1084566a09bb6c4ec92134f&scope.project.id=754d04e2573f4c81b21775be5d8d103e&role.id=82138515a02147ccb30f8d56863aab87 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:07.398622 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c6f88f-147d-4ca5-abce-9c2a0e834760 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:07.433600 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05a98c1-75a4-4969-b81e-531d066df7f3 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:07.436601 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:07.472032 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27da9e12-d58b-4061-8a1a-fe092ee7568c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:07.473032 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27da9e12-d58b-4061-8a1a-fe092ee7568c None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:07.473032 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27da9e12-d58b-4061-8a1a-fe092ee7568c None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:07.473363 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27da9e12-d58b-4061-8a1a-fe092ee7568c None admin] PATH_INFO: `/v3/users/b209a483d1084566a09bb6c4ec92134f` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:07.474717 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27da9e12-d58b-4061-8a1a-fe092ee7568c None admin] RBAC: Authorizing `identity:get_user(user_id=b209a483d1084566a09bb6c4ec92134f)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:07.476143 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27da9e12-d58b-4061-8a1a-fe092ee7568c None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:07.478084 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 44/88] 10.222.0.23 () {56 vars in 1177 bytes} [Sat Oct 1 20:32:07 2022] GET /identity/v3/users/b209a483d1084566a09bb6c4ec92134f => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:07.478655 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27da9e12-d58b-4061-8a1a-fe092ee7568c None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:07.531205 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c6f88f-147d-4ca5-abce-9c2a0e834760 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:07.612698 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f769d857-5513-45fb-a8ae-c06e467b38b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:07.612698 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f769d857-5513-45fb-a8ae-c06e467b38b3 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:07.612698 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f769d857-5513-45fb-a8ae-c06e467b38b3 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:07.612698 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f769d857-5513-45fb-a8ae-c06e467b38b3 None admin] PATH_INFO: `/v3/projects/754d04e2573f4c81b21775be5d8d103e` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:07.613168 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f769d857-5513-45fb-a8ae-c06e467b38b3 None admin] RBAC: Authorizing `identity:get_project(project_id=754d04e2573f4c81b21775be5d8d103e)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:07.613168 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f769d857-5513-45fb-a8ae-c06e467b38b3 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:07.615100 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 45/89] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Oct 1 20:32:07 2022] GET /identity/v3/projects/754d04e2573f4c81b21775be5d8d103e => generated 298 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:07.615941 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f769d857-5513-45fb-a8ae-c06e467b38b3 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:07.638291 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27da9e12-d58b-4061-8a1a-fe092ee7568c None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:07.684761 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427d004a-c746-400b-8420-3097474bdca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:07.686227 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d004a-c746-400b-8420-3097474bdca4 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:07.686809 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d004a-c746-400b-8420-3097474bdca4 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:07.687284 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d004a-c746-400b-8420-3097474bdca4 None admin] PATH_INFO: `/v3/users/b209a483d1084566a09bb6c4ec92134f` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:07.690133 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427d004a-c746-400b-8420-3097474bdca4 None admin] RBAC: Authorizing `identity:get_user(user_id=b209a483d1084566a09bb6c4ec92134f)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:07.691998 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427d004a-c746-400b-8420-3097474bdca4 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:07.694888 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 45/90] 10.222.0.23 () {56 vars in 1177 bytes} [Sat Oct 1 20:32:07 2022] GET /identity/v3/users/b209a483d1084566a09bb6c4ec92134f => generated 275 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:07.695911 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427d004a-c746-400b-8420-3097474bdca4 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:07.748491 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:07.771415 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:07.818729 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f769d857-5513-45fb-a8ae-c06e467b38b3 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:07.825130 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427d004a-c746-400b-8420-3097474bdca4 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:07.864092 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c9edb1-3892-4578-916e-2919012e17ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:07.865110 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c9edb1-3892-4578-916e-2919012e17ce None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:07.865622 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c9edb1-3892-4578-916e-2919012e17ce None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:07.866089 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c9edb1-3892-4578-916e-2919012e17ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:07.867044 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c9edb1-3892-4578-916e-2919012e17ce None admin] RBAC: Adding query filter params (role.id=d11e7ba2f1fa41ff8ea8dda2a8d1466f, scope.project.id=754d04e2573f4c81b21775be5d8d103e, user.id=6d59f4f70f764f57b1d8cf05402fdf0e) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:32:07.867561 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c9edb1-3892-4578-916e-2919012e17ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:07.869253 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c9edb1-3892-4578-916e-2919012e17ce None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:07.870151 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd4b7d6-a997-4bbf-a899-138fb2a86fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:07.870775 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd4b7d6-a997-4bbf-a899-138fb2a86fb5 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:07.871054 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd4b7d6-a997-4bbf-a899-138fb2a86fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:07.871328 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd4b7d6-a997-4bbf-a899-138fb2a86fb5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:07.878038 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 46/91] 10.222.0.23 () {56 vars in 1374 bytes} [Sat Oct 1 20:32:07 2022] GET /identity/v3/role_assignments?user.id=6d59f4f70f764f57b1d8cf05402fdf0e&scope.project.id=754d04e2573f4c81b21775be5d8d103e&role.id=d11e7ba2f1fa41ff8ea8dda2a8d1466f => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:07.879251 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c9edb1-3892-4578-916e-2919012e17ce None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:07.996264 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:08.000475 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c9edb1-3892-4578-916e-2919012e17ce None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:08.040512 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b762b3-7ef6-472f-9a86-bd719773bc3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:08.042045 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b762b3-7ef6-472f-9a86-bd719773bc3b None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:08.042526 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b762b3-7ef6-472f-9a86-bd719773bc3b None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:08.043010 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b762b3-7ef6-472f-9a86-bd719773bc3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:08.061715 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd4b7d6-a997-4bbf-a899-138fb2a86fb5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:08.063236 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd4b7d6-a997-4bbf-a899-138fb2a86fb5 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:08.122954 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b762b3-7ef6-472f-9a86-bd719773bc3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:08.124877 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b762b3-7ef6-472f-9a86-bd719773bc3b None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:08.199161 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:08.243275 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:08.248750 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 47/92] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Oct 1 20:32:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 01 20:32:08.255480 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b762b3-7ef6-472f-9a86-bd719773bc3b None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:08.293732 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 46/93] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Oct 1 20:32:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 678 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 01 20:32:08.301890 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd4b7d6-a997-4bbf-a899-138fb2a86fb5 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:08.385863 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b762b3-7ef6-472f-9a86-bd719773bc3b None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:08.427166 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc196923-1368-491c-a584-e31e7c7ee7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:08.428186 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc196923-1368-491c-a584-e31e7c7ee7ae None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:08.428693 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc196923-1368-491c-a584-e31e7c7ee7ae None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:08.429172 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc196923-1368-491c-a584-e31e7c7ee7ae None admin] PATH_INFO: `/v3/projects/0f5d7a8894224723b2e587bed1efaf3f` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:08.430593 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc196923-1368-491c-a584-e31e7c7ee7ae None admin] RBAC: Authorizing `identity:get_project(project_id=0f5d7a8894224723b2e587bed1efaf3f)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:08.432294 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc196923-1368-491c-a584-e31e7c7ee7ae None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:08.434255 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 48/94] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Oct 1 20:32:08 2022] GET /identity/v3/projects/0f5d7a8894224723b2e587bed1efaf3f => generated 312 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:08.440208 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc196923-1368-491c-a584-e31e7c7ee7ae None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:08.498707 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd4b7d6-a997-4bbf-a899-138fb2a86fb5 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:08.524617 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:08.568385 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc196923-1368-491c-a584-e31e7c7ee7ae None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:08.570980 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41229c58-3801-4954-a1ce-7aa0d8e085b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:08.572165 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41229c58-3801-4954-a1ce-7aa0d8e085b0 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:08.572165 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41229c58-3801-4954-a1ce-7aa0d8e085b0 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:08.572351 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41229c58-3801-4954-a1ce-7aa0d8e085b0 None admin] PATH_INFO: `/v3/projects/754d04e2573f4c81b21775be5d8d103e` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:08.577595 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41229c58-3801-4954-a1ce-7aa0d8e085b0 None admin] RBAC: Authorizing `identity:get_project(project_id=754d04e2573f4c81b21775be5d8d103e)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:08.578785 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41229c58-3801-4954-a1ce-7aa0d8e085b0 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:08.581426 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 47/95] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Oct 1 20:32:08 2022] GET /identity/v3/projects/754d04e2573f4c81b21775be5d8d103e => generated 298 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:08.587175 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41229c58-3801-4954-a1ce-7aa0d8e085b0 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:08.609631 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60aa9ee-484e-48d5-add2-4db21cdfb378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:08.611814 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60aa9ee-484e-48d5-add2-4db21cdfb378 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:08.612271 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60aa9ee-484e-48d5-add2-4db21cdfb378 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:08.612759 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60aa9ee-484e-48d5-add2-4db21cdfb378 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:08.613800 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60aa9ee-484e-48d5-add2-4db21cdfb378 None admin] RBAC: Adding query filter params (role.id=82138515a02147ccb30f8d56863aab87, scope.project.id=0f5d7a8894224723b2e587bed1efaf3f, user.id=b209a483d1084566a09bb6c4ec92134f) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:32:08.614257 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60aa9ee-484e-48d5-add2-4db21cdfb378 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:08.616000 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60aa9ee-484e-48d5-add2-4db21cdfb378 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:08.622926 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 49/96] 10.222.0.23 () {56 vars in 1374 bytes} [Sat Oct 1 20:32:08 2022] GET /identity/v3/role_assignments?user.id=b209a483d1084566a09bb6c4ec92134f&scope.project.id=0f5d7a8894224723b2e587bed1efaf3f&role.id=82138515a02147ccb30f8d56863aab87 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:08.653680 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:08.774351 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41229c58-3801-4954-a1ce-7aa0d8e085b0 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:08.830710 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ddc63e-0470-480a-bc28-9d41dee420fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:08.831334 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ddc63e-0470-480a-bc28-9d41dee420fb None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:08.831614 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ddc63e-0470-480a-bc28-9d41dee420fb None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:08.831887 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ddc63e-0470-480a-bc28-9d41dee420fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:08.832653 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ddc63e-0470-480a-bc28-9d41dee420fb None admin] RBAC: Adding query filter params (role.id=8789e127ff4549b4883a92a87573ad3e, scope.project.id=754d04e2573f4c81b21775be5d8d103e, user.id=b209a483d1084566a09bb6c4ec92134f) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:32:08.832960 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ddc63e-0470-480a-bc28-9d41dee420fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:08.834437 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ddc63e-0470-480a-bc28-9d41dee420fb None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:08.840752 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 48/97] 10.222.0.23 () {56 vars in 1374 bytes} [Sat Oct 1 20:32:08 2022] GET /identity/v3/role_assignments?user.id=b209a483d1084566a09bb6c4ec92134f&scope.project.id=754d04e2573f4c81b21775be5d8d103e&role.id=8789e127ff4549b4883a92a87573ad3e => generated 259 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 20:32:10.114544 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc367f5f-8beb-4353-9aa7-cd68e9a00c58 None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:10.115060 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc367f5f-8beb-4353-9aa7-cd68e9a00c58 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:10.115132 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc367f5f-8beb-4353-9aa7-cd68e9a00c58 None None] PATH_INFO: `/` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:10.116515 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 50/98] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:32:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 01 20:32:10.122915 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273595f4-f891-4feb-9d15-fb6e0abb91b0 None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:10.123365 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273595f4-f891-4feb-9d15-fb6e0abb91b0 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:10.123555 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273595f4-f891-4feb-9d15-fb6e0abb91b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:10.147568 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-273595f4-f891-4feb-9d15-fb6e0abb91b0 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:32:10.148854 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-273595f4-f891-4feb-9d15-fb6e0abb91b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:32:10.250621 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 49/99] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:32:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 20:32:10.280274 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed303f-c645-4e61-bf22-66dd71975fb8 None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:10.280565 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed303f-c645-4e61-bf22-66dd71975fb8 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:10.280907 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed303f-c645-4e61-bf22-66dd71975fb8 None None] PATH_INFO: `/` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:10.283267 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 51/100] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:32:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:32:10.292807 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db27b5-fd25-460a-9440-74d8c6301e0d None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:10.293639 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db27b5-fd25-460a-9440-74d8c6301e0d None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:10.294391 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db27b5-fd25-460a-9440-74d8c6301e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:10.338506 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-89db27b5-fd25-460a-9440-74d8c6301e0d None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:32:10.341000 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-89db27b5-fd25-460a-9440-74d8c6301e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:32:10.368924 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:10.441845 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 50/101] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:32:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 20:32:10.839282 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aed303f-c645-4e61-bf22-66dd71975fb8 None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:10.970793 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aed303f-c645-4e61-bf22-66dd71975fb8 None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:10.974612 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b387376e-b2d2-41a6-8fa2-91f7be1d1b07 None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:10.974899 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b387376e-b2d2-41a6-8fa2-91f7be1d1b07 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:10.975179 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b387376e-b2d2-41a6-8fa2-91f7be1d1b07 None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:10.976538 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 51/102] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:32:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 01 20:32:10.988257 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da0f0a3-03d4-425c-b212-7417633447b7 None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:10.988579 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da0f0a3-03d4-425c-b212-7417633447b7 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:10.988906 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da0f0a3-03d4-425c-b212-7417633447b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:11.017748 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-3da0f0a3-03d4-425c-b212-7417633447b7 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:32:11.020064 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-3da0f0a3-03d4-425c-b212-7417633447b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:32:11.043898 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:11.054660 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c44e83-d72e-4e28-8a00-75622e74d617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:11.055313 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c44e83-d72e-4e28-8a00-75622e74d617 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:11.055592 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c44e83-d72e-4e28-8a00-75622e74d617 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:11.055867 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c44e83-d72e-4e28-8a00-75622e74d617 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:11.078729 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c44e83-d72e-4e28-8a00-75622e74d617 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 20:32:11.085955 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application [None req-55c44e83-d72e-4e28-8a00-75622e74d617 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 01 20:32:11.085955 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:32:11.085955 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:32:11.085955 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:32:11.085955 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:32:11.085955 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:32:11.085955 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:32:11.085955 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:32:11.085955 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:32:11.085955 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:32:11.085955 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:32:11.085955 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:32:11.085955 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 20:32:11.085955 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 20:32:11.085955 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 20:32:11.085955 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 20:32:11.086833 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 20:32:11.086833 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 20:32:11.086833 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 20:32:11.086833 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 20:32:11.086833 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:32:11.086833 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:32:11.086833 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:32:11.086833 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:32:11.086833 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:32:11.086833 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:32:11.086833 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:32:11.086833 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application with Lock( Oct 01 20:32:11.086833 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:32:11.086833 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:32:11.086833 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:32:11.086833 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:32:11.087588 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:32:11.087588 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:32:11.087588 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:32:11.087588 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:32:11.087588 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 20:32:11.087588 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 20:32:11.087588 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 20:32:11.087588 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 20:32:11.087588 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 20:32:11.087588 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 20:32:11.087588 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 01 20:32:11.087588 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:32:11.089994 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 52/103] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Oct 1 20:32:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:32:11.096380 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c44e83-d72e-4e28-8a00-75622e74d617 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:11.171646 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 52/104] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:32:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 01 20:32:11.172165 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da0f0a3-03d4-425c-b212-7417633447b7 None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:11.269183 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c44e83-d72e-4e28-8a00-75622e74d617 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:11.321916 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:11.346038 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12f80c1-948e-4229-90ba-228f8f490bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:11.346584 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12f80c1-948e-4229-90ba-228f8f490bc8 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:11.346868 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12f80c1-948e-4229-90ba-228f8f490bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:11.347156 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12f80c1-948e-4229-90ba-228f8f490bc8 None admin] PATH_INFO: `/v3/roles` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:11.347845 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12f80c1-948e-4229-90ba-228f8f490bc8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:32:11.348152 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12f80c1-948e-4229-90ba-228f8f490bc8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:11.349630 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12f80c1-948e-4229-90ba-228f8f490bc8 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:11.351234 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da0f0a3-03d4-425c-b212-7417633447b7 None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:11.358624 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 53/105] 10.222.0.23 () {56 vars in 1101 bytes} [Sat Oct 1 20:32:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:11.365425 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12f80c1-948e-4229-90ba-228f8f490bc8 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:11.411877 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df69de21-aa52-4f7e-9a1b-fb2e25ec1958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:11.412518 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df69de21-aa52-4f7e-9a1b-fb2e25ec1958 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:11.412823 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df69de21-aa52-4f7e-9a1b-fb2e25ec1958 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:11.413100 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df69de21-aa52-4f7e-9a1b-fb2e25ec1958 None admin] PATH_INFO: `/v3/domains/default` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:11.414367 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df69de21-aa52-4f7e-9a1b-fb2e25ec1958 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:11.416693 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df69de21-aa52-4f7e-9a1b-fb2e25ec1958 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:11.419553 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 53/106] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Oct 1 20:32:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:11.424388 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df69de21-aa52-4f7e-9a1b-fb2e25ec1958 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:11.460872 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:11.542940 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12f80c1-948e-4229-90ba-228f8f490bc8 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:11.613892 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df69de21-aa52-4f7e-9a1b-fb2e25ec1958 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:11.616015 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc86aa-3c2b-48da-a378-834ddf3bbce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:11.616692 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc86aa-3c2b-48da-a378-834ddf3bbce6 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:11.616976 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc86aa-3c2b-48da-a378-834ddf3bbce6 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:11.617295 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc86aa-3c2b-48da-a378-834ddf3bbce6 None admin] PATH_INFO: `/v3/users/2bb3ed388eb64483a07605d22e91f089` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:11.645072 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfc86aa-3c2b-48da-a378-834ddf3bbce6 None admin] RBAC: Authorizing `identity:get_user(user_id=2bb3ed388eb64483a07605d22e91f089)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:11.646771 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfc86aa-3c2b-48da-a378-834ddf3bbce6 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:11.649914 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 54/107] 10.222.0.23 () {56 vars in 1177 bytes} [Sat Oct 1 20:32:11 2022] GET /identity/v3/users/2bb3ed388eb64483a07605d22e91f089 => generated 289 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 20:32:11.655063 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc86aa-3c2b-48da-a378-834ddf3bbce6 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:11.682407 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7dee35-8bcc-46fd-ac59-6f4db8dd50ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:11.683024 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7dee35-8bcc-46fd-ac59-6f4db8dd50ed None admin] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:11.683309 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7dee35-8bcc-46fd-ac59-6f4db8dd50ed None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:11.683582 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7dee35-8bcc-46fd-ac59-6f4db8dd50ed None admin] PATH_INFO: `/v3/projects` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:11.684233 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7dee35-8bcc-46fd-ac59-6f4db8dd50ed None admin] RBAC: Authorizing `identity:create_project()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:11.686850 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7dee35-8bcc-46fd-ac59-6f4db8dd50ed None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:11.749339 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 54/108] 10.222.0.23 () {60 vars in 1141 bytes} [Sat Oct 1 20:32:11 2022] POST /identity/v3/projects => generated 302 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 20:32:11.793802 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc86aa-3c2b-48da-a378-834ddf3bbce6 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:11.811637 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:11.834117 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3007ed1-ba50-4d03-88b2-225503a20bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:11.834735 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3007ed1-ba50-4d03-88b2-225503a20bdc None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:11.835018 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3007ed1-ba50-4d03-88b2-225503a20bdc None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:11.835291 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3007ed1-ba50-4d03-88b2-225503a20bdc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:11.892537 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7dee35-8bcc-46fd-ac59-6f4db8dd50ed None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:11.899134 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:11.914023 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3007ed1-ba50-4d03-88b2-225503a20bdc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:11.915511 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3007ed1-ba50-4d03-88b2-225503a20bdc None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:12.030908 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 55/109] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Oct 1 20:32:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 01 20:32:12.037221 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3007ed1-ba50-4d03-88b2-225503a20bdc None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:12.053124 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:12.062434 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7dee35-8bcc-46fd-ac59-6f4db8dd50ed None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:12.146247 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51500b42-511e-47e3-ac09-f183cd7b097b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:12.147241 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51500b42-511e-47e3-ac09-f183cd7b097b None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:12.147729 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51500b42-511e-47e3-ac09-f183cd7b097b None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:12.148219 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51500b42-511e-47e3-ac09-f183cd7b097b None admin] PATH_INFO: `/v3/roles/member` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:12.153776 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3007ed1-ba50-4d03-88b2-225503a20bdc None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:12.182419 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51500b42-511e-47e3-ac09-f183cd7b097b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 20:32:12.188128 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-51500b42-511e-47e3-ac09-f183cd7b097b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 01 20:32:12.188128 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:32:12.188128 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:32:12.188128 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:32:12.188128 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:32:12.188128 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:32:12.188128 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:32:12.188128 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:32:12.188128 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:32:12.188128 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:32:12.188128 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:32:12.188128 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:32:12.188128 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 20:32:12.188128 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 20:32:12.188128 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 20:32:12.188128 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 20:32:12.189181 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 20:32:12.189181 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 20:32:12.189181 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 20:32:12.189181 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 20:32:12.189181 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:32:12.189181 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:32:12.189181 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:32:12.189181 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:32:12.189181 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:32:12.189181 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:32:12.189181 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:32:12.189181 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:32:12.189181 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:32:12.189181 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:32:12.189181 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:32:12.189181 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:32:12.189934 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:32:12.189934 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:32:12.189934 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:32:12.189934 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:32:12.189934 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 20:32:12.189934 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 20:32:12.189934 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 20:32:12.189934 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 20:32:12.189934 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 20:32:12.189934 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 20:32:12.189934 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 01 20:32:12.189934 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:32:12.189934 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 55/110] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Oct 1 20:32:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 01 20:32:12.197101 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51500b42-511e-47e3-ac09-f183cd7b097b None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:12.197409 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c81dba7-4e07-4e86-94b3-fcd451d9b4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:12.198071 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81dba7-4e07-4e86-94b3-fcd451d9b4a4 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:12.198354 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81dba7-4e07-4e86-94b3-fcd451d9b4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:12.198634 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81dba7-4e07-4e86-94b3-fcd451d9b4a4 None admin] PATH_INFO: `/v3/projects/754d04e2573f4c81b21775be5d8d103e` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:12.199836 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c81dba7-4e07-4e86-94b3-fcd451d9b4a4 None admin] RBAC: Authorizing `identity:get_project(project_id=754d04e2573f4c81b21775be5d8d103e)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:12.201395 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c81dba7-4e07-4e86-94b3-fcd451d9b4a4 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:12.203298 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 56/111] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Oct 1 20:32:12 2022] GET /identity/v3/projects/754d04e2573f4c81b21775be5d8d103e => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 20:32:12.210372 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c81dba7-4e07-4e86-94b3-fcd451d9b4a4 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:12.300682 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:12.322525 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c81dba7-4e07-4e86-94b3-fcd451d9b4a4 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:12.327080 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:12.360040 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633261a1-bcb9-412b-a166-599b34aeee01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:12.361557 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633261a1-bcb9-412b-a166-599b34aeee01 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:12.362073 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633261a1-bcb9-412b-a166-599b34aeee01 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:12.362494 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633261a1-bcb9-412b-a166-599b34aeee01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:12.363463 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633261a1-bcb9-412b-a166-599b34aeee01 None admin] RBAC: Adding query filter params (role.id=593409d904954a0f8039eda5aa05fc40, scope.project.id=754d04e2573f4c81b21775be5d8d103e, user.id=2bb3ed388eb64483a07605d22e91f089) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:32:12.363914 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633261a1-bcb9-412b-a166-599b34aeee01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:12.365669 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633261a1-bcb9-412b-a166-599b34aeee01 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:12.371902 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 57/112] 10.222.0.23 () {56 vars in 1374 bytes} [Sat Oct 1 20:32:12 2022] GET /identity/v3/role_assignments?user.id=2bb3ed388eb64483a07605d22e91f089&scope.project.id=754d04e2573f4c81b21775be5d8d103e&role.id=593409d904954a0f8039eda5aa05fc40 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 20:32:12.372974 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51500b42-511e-47e3-ac09-f183cd7b097b None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:12.373282 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b990daf5-a6dd-46bf-8e44-a318fa869ee1 None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:12.373559 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b990daf5-a6dd-46bf-8e44-a318fa869ee1 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:12.373831 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b990daf5-a6dd-46bf-8e44-a318fa869ee1 None None] PATH_INFO: `/` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:12.375015 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 58/113] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:32:12 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:32:12.383867 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d17120-a49f-40c8-9546-488da6cbb238 None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:12.384391 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d17120-a49f-40c8-9546-488da6cbb238 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:12.384830 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d17120-a49f-40c8-9546-488da6cbb238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:12.409123 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-85d17120-a49f-40c8-9546-488da6cbb238 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:32:12.410719 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-85d17120-a49f-40c8-9546-488da6cbb238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:32:12.448578 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaf1f8f-f0b1-4424-bd86-80cb012ae333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:12.448578 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaf1f8f-f0b1-4424-bd86-80cb012ae333 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:12.448578 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaf1f8f-f0b1-4424-bd86-80cb012ae333 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:12.448578 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaf1f8f-f0b1-4424-bd86-80cb012ae333 None admin] PATH_INFO: `/v3/roles` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:12.449009 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaf1f8f-f0b1-4424-bd86-80cb012ae333 None admin] RBAC: Adding query filter params (name=member) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:32:12.449009 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaf1f8f-f0b1-4424-bd86-80cb012ae333 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:12.449009 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaf1f8f-f0b1-4424-bd86-80cb012ae333 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:12.459634 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 56/114] 10.222.0.23 () {56 vars in 1101 bytes} [Sat Oct 1 20:32:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 20:32:12.467195 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaf1f8f-f0b1-4424-bd86-80cb012ae333 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:12.519329 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 59/115] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:32:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 20:32:12.617759 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaf1f8f-f0b1-4424-bd86-80cb012ae333 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:12.654101 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:12.663516 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535176f9-0ada-43e0-a780-885b0be4c6be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:12.664090 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535176f9-0ada-43e0-a780-885b0be4c6be None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:12.664377 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535176f9-0ada-43e0-a780-885b0be4c6be None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:12.664681 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535176f9-0ada-43e0-a780-885b0be4c6be None admin] PATH_INFO: `/v3/users/b209a483d1084566a09bb6c4ec92134f` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:12.665829 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535176f9-0ada-43e0-a780-885b0be4c6be None admin] RBAC: Authorizing `identity:get_user(user_id=b209a483d1084566a09bb6c4ec92134f)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:12.667298 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535176f9-0ada-43e0-a780-885b0be4c6be None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:12.669100 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 57/116] 10.222.0.23 () {56 vars in 1177 bytes} [Sat Oct 1 20:32:12 2022] GET /identity/v3/users/b209a483d1084566a09bb6c4ec92134f => generated 275 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:12.675273 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d17120-a49f-40c8-9546-488da6cbb238 None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:12.774121 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9945c75-164c-41a4-bcb4-bab996788268 None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:12.774430 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9945c75-164c-41a4-bcb4-bab996788268 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:12.774632 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9945c75-164c-41a4-bcb4-bab996788268 None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:12.775979 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 58/117] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:32:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:32:12.781411 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e87747b-c9c8-46e2-8b7b-248b6cabd639 None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:12.781700 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e87747b-c9c8-46e2-8b7b-248b6cabd639 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:12.782030 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e87747b-c9c8-46e2-8b7b-248b6cabd639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:12.796909 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:12.804715 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-2e87747b-c9c8-46e2-8b7b-248b6cabd639 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:32:12.805945 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-2e87747b-c9c8-46e2-8b7b-248b6cabd639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:32:12.831327 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d17120-a49f-40c8-9546-488da6cbb238 None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:12.871282 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6975d7-2121-438e-8547-e2c4cf26e7d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:12.875670 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6975d7-2121-438e-8547-e2c4cf26e7d8 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:12.876210 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6975d7-2121-438e-8547-e2c4cf26e7d8 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:12.876719 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6975d7-2121-438e-8547-e2c4cf26e7d8 None admin] PATH_INFO: `/v3/projects/754d04e2573f4c81b21775be5d8d103e` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:12.878127 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6975d7-2121-438e-8547-e2c4cf26e7d8 None admin] RBAC: Authorizing `identity:get_project(project_id=754d04e2573f4c81b21775be5d8d103e)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:12.879780 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6975d7-2121-438e-8547-e2c4cf26e7d8 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:12.883200 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 60/118] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Oct 1 20:32:12 2022] GET /identity/v3/projects/754d04e2573f4c81b21775be5d8d103e => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:12.893196 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6975d7-2121-438e-8547-e2c4cf26e7d8 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:12.947270 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 59/119] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:32:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 01 20:32:12.948650 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df027f-5886-47d9-9288-ffa4191840cf None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:12.948940 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df027f-5886-47d9-9288-ffa4191840cf None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:12.949217 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df027f-5886-47d9-9288-ffa4191840cf None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:12.950458 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 60/120] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:32:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:32:12.961299 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e82f4-f0be-4726-a50d-daf56f81e015 None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:12.961587 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e82f4-f0be-4726-a50d-daf56f81e015 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:12.961861 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e82f4-f0be-4726-a50d-daf56f81e015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:13.008631 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-ca5e82f4-f0be-4726-a50d-daf56f81e015 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:32:13.009889 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-ca5e82f4-f0be-4726-a50d-daf56f81e015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:32:13.031295 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6975d7-2121-438e-8547-e2c4cf26e7d8 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:13.100496 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e0752-8771-4683-8916-ee458b4dbb92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:13.101187 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e0752-8771-4683-8916-ee458b4dbb92 None admin] REQUEST_METHOD: `PUT` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:13.101468 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e0752-8771-4683-8916-ee458b4dbb92 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:13.101742 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e0752-8771-4683-8916-ee458b4dbb92 None admin] PATH_INFO: `/v3/projects/754d04e2573f4c81b21775be5d8d103e/users/b209a483d1084566a09bb6c4ec92134f/roles/82138515a02147ccb30f8d56863aab87` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:13.106183 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754e0752-8771-4683-8916-ee458b4dbb92 None admin] RBAC: Authorizing `identity:create_grant(project_id=754d04e2573f4c81b21775be5d8d103e, user_id=b209a483d1084566a09bb6c4ec92134f, role_id=82138515a02147ccb30f8d56863aab87)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:13.107650 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754e0752-8771-4683-8916-ee458b4dbb92 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:13.132274 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 61/121] 10.222.0.23 () {58 vars in 1439 bytes} [Sat Oct 1 20:32:12 2022] PUT /identity/v3/projects/754d04e2573f4c81b21775be5d8d103e/users/b209a483d1084566a09bb6c4ec92134f/roles/82138515a02147ccb30f8d56863aab87 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 20:32:13.133570 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e0752-8771-4683-8916-ee458b4dbb92 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:13.140727 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:13.151525 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 61/122] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:32:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 20:32:13.299685 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e0752-8771-4683-8916-ee458b4dbb92 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:13.346515 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64b2217-3ab6-496e-a768-00e20261cf3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:13.347297 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b2217-3ab6-496e-a768-00e20261cf3a None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:13.348645 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5e82f4-f0be-4726-a50d-daf56f81e015 None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:13.351174 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b2217-3ab6-496e-a768-00e20261cf3a None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:13.352410 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b2217-3ab6-496e-a768-00e20261cf3a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:13.372254 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64b2217-3ab6-496e-a768-00e20261cf3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 20:32:13.378903 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application [None req-a64b2217-3ab6-496e-a768-00e20261cf3a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 20:32:13.378903 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:32:13.378903 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:32:13.378903 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:32:13.378903 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:32:13.378903 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:32:13.378903 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:32:13.378903 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:32:13.378903 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:32:13.378903 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:32:13.378903 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:32:13.378903 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:32:13.378903 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 20:32:13.378903 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 20:32:13.378903 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 20:32:13.378903 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 20:32:13.379857 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 20:32:13.379857 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 20:32:13.379857 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 20:32:13.379857 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 20:32:13.379857 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:32:13.379857 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:32:13.379857 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:32:13.379857 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:32:13.379857 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:32:13.379857 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:32:13.379857 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:32:13.379857 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application with Lock( Oct 01 20:32:13.379857 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:32:13.379857 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:32:13.379857 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:32:13.379857 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:32:13.380686 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:32:13.380686 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:32:13.380686 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:32:13.380686 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:32:13.380686 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 20:32:13.380686 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 20:32:13.380686 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 20:32:13.380686 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 20:32:13.380686 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 20:32:13.380686 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 20:32:13.380686 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 20:32:13.380686 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:32:13.380686 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 62/123] 10.222.0.23 () {56 vars in 1096 bytes} [Sat Oct 1 20:32:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:32:13.386760 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64b2217-3ab6-496e-a768-00e20261cf3a None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:13.480936 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:13.495088 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:13.541117 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64b2217-3ab6-496e-a768-00e20261cf3a None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:13.582231 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4ad853-9fda-4f69-9e18-610f8d1884d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:13.582769 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ad853-9fda-4f69-9e18-610f8d1884d5 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:13.583056 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ad853-9fda-4f69-9e18-610f8d1884d5 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:13.583334 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ad853-9fda-4f69-9e18-610f8d1884d5 None admin] PATH_INFO: `/v3/roles` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:13.584003 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4ad853-9fda-4f69-9e18-610f8d1884d5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:32:13.584499 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4ad853-9fda-4f69-9e18-610f8d1884d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:13.586241 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4ad853-9fda-4f69-9e18-610f8d1884d5 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:13.595911 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 63/124] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Oct 1 20:32:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 20:32:13.601749 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4ad853-9fda-4f69-9e18-610f8d1884d5 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:13.627927 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5e82f4-f0be-4726-a50d-daf56f81e015 None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:13.740390 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4ad853-9fda-4f69-9e18-610f8d1884d5 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:13.755052 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0e6978-171b-4105-82e1-9a77798cc036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:13.755726 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0e6978-171b-4105-82e1-9a77798cc036 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:13.756007 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0e6978-171b-4105-82e1-9a77798cc036 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:13.756353 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0e6978-171b-4105-82e1-9a77798cc036 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:13.778953 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0e6978-171b-4105-82e1-9a77798cc036 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 20:32:13.784325 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-ca0e6978-171b-4105-82e1-9a77798cc036 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 01 20:32:13.784325 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:32:13.784325 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:32:13.784325 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:32:13.784325 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:32:13.784325 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:32:13.784325 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:32:13.784325 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:32:13.784325 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:32:13.784325 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:32:13.784325 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:32:13.784325 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:32:13.784325 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 20:32:13.784325 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 20:32:13.784325 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 20:32:13.784325 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 20:32:13.785182 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 20:32:13.785182 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 20:32:13.785182 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 20:32:13.785182 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 20:32:13.785182 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:32:13.785182 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:32:13.785182 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:32:13.785182 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:32:13.785182 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:32:13.785182 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:32:13.785182 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:32:13.785182 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:32:13.785182 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:32:13.785182 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:32:13.785182 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:32:13.785182 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:32:13.785957 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:32:13.785957 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:32:13.785957 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:32:13.785957 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:32:13.785957 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 20:32:13.785957 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 20:32:13.785957 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 20:32:13.785957 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 20:32:13.785957 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 20:32:13.785957 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 20:32:13.785957 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 01 20:32:13.785957 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:32:13.785957 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 62/125] 10.222.0.23 () {56 vars in 1114 bytes} [Sat Oct 1 20:32:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 437 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 01 20:32:13.786587 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0e6978-171b-4105-82e1-9a77798cc036 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:13.796915 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:13.812052 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457bd96a-fa55-4253-a8de-0aa03fadbf17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:13.812722 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457bd96a-fa55-4253-a8de-0aa03fadbf17 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:13.813000 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457bd96a-fa55-4253-a8de-0aa03fadbf17 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:13.813342 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457bd96a-fa55-4253-a8de-0aa03fadbf17 None admin] PATH_INFO: `/v3/users/6d59f4f70f764f57b1d8cf05402fdf0e` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:13.814563 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457bd96a-fa55-4253-a8de-0aa03fadbf17 None admin] RBAC: Authorizing `identity:get_user(user_id=6d59f4f70f764f57b1d8cf05402fdf0e)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:13.816028 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457bd96a-fa55-4253-a8de-0aa03fadbf17 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:13.817897 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 64/126] 10.222.0.23 () {56 vars in 1177 bytes} [Sat Oct 1 20:32:13 2022] GET /identity/v3/users/6d59f4f70f764f57b1d8cf05402fdf0e => generated 247 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 20:32:13.818478 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457bd96a-fa55-4253-a8de-0aa03fadbf17 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:13.919972 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0e6978-171b-4105-82e1-9a77798cc036 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:13.936088 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:13.961109 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f239c2c-f84a-4dc2-9cac-e3b534f90b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:13.962014 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f239c2c-f84a-4dc2-9cac-e3b534f90b19 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:13.962534 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f239c2c-f84a-4dc2-9cac-e3b534f90b19 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:13.962962 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f239c2c-f84a-4dc2-9cac-e3b534f90b19 None admin] PATH_INFO: `/v3/roles/member` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:13.976001 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f239c2c-f84a-4dc2-9cac-e3b534f90b19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 20:32:13.981106 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-3f239c2c-f84a-4dc2-9cac-e3b534f90b19 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 01 20:32:13.981106 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:32:13.981106 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:32:13.981106 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:32:13.981106 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:32:13.981106 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:32:13.981106 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:32:13.981106 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:32:13.981106 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:32:13.981106 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:32:13.981106 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:32:13.981106 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:32:13.981106 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 20:32:13.981106 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 20:32:13.981106 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 20:32:13.981106 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 20:32:13.982035 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 20:32:13.982035 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 20:32:13.982035 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 20:32:13.982035 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 20:32:13.982035 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:32:13.982035 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:32:13.982035 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:32:13.982035 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:32:13.982035 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:32:13.982035 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:32:13.982035 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:32:13.982035 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:32:13.982035 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:32:13.982035 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:32:13.982035 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:32:13.982035 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:32:13.982994 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:32:13.982994 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:32:13.982994 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:32:13.982994 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:32:13.982994 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 20:32:13.982994 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 20:32:13.982994 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 20:32:13.982994 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 20:32:13.982994 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 20:32:13.982994 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 20:32:13.982994 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 01 20:32:13.982994 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:32:13.984943 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 63/127] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Oct 1 20:32:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:32:13.985981 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f239c2c-f84a-4dc2-9cac-e3b534f90b19 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:14.090401 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f239c2c-f84a-4dc2-9cac-e3b534f90b19 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:14.090621 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457bd96a-fa55-4253-a8de-0aa03fadbf17 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:14.131420 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969bc977-1e8f-436c-a88c-f1262a0f5b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:14.132097 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969bc977-1e8f-436c-a88c-f1262a0f5b8a None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:14.132383 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969bc977-1e8f-436c-a88c-f1262a0f5b8a None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:14.132691 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969bc977-1e8f-436c-a88c-f1262a0f5b8a None admin] PATH_INFO: `/v3/roles` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:14.133361 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969bc977-1e8f-436c-a88c-f1262a0f5b8a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:32:14.133669 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969bc977-1e8f-436c-a88c-f1262a0f5b8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:14.135081 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969bc977-1e8f-436c-a88c-f1262a0f5b8a None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:14.147782 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 65/128] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Oct 1 20:32:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:14.148432 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969bc977-1e8f-436c-a88c-f1262a0f5b8a None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:14.159181 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82180e74-efae-4a65-8661-6714d4d16a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:14.159831 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82180e74-efae-4a65-8661-6714d4d16a86 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:14.160110 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82180e74-efae-4a65-8661-6714d4d16a86 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:14.160382 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82180e74-efae-4a65-8661-6714d4d16a86 None admin] PATH_INFO: `/v3/projects/754d04e2573f4c81b21775be5d8d103e` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:14.161711 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82180e74-efae-4a65-8661-6714d4d16a86 None admin] RBAC: Authorizing `identity:get_project(project_id=754d04e2573f4c81b21775be5d8d103e)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:14.163161 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82180e74-efae-4a65-8661-6714d4d16a86 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:14.169721 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 64/129] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Oct 1 20:32:13 2022] GET /identity/v3/projects/754d04e2573f4c81b21775be5d8d103e => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:14.170625 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82180e74-efae-4a65-8661-6714d4d16a86 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:14.257174 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:14.263910 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:14.312558 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82180e74-efae-4a65-8661-6714d4d16a86 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:14.364137 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5924f997-173e-41c5-94c5-8d6b98097730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:14.364969 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5924f997-173e-41c5-94c5-8d6b98097730 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:14.365198 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5924f997-173e-41c5-94c5-8d6b98097730 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:14.365473 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5924f997-173e-41c5-94c5-8d6b98097730 None admin] PATH_INFO: `/v3/users/b209a483d1084566a09bb6c4ec92134f` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:14.366617 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5924f997-173e-41c5-94c5-8d6b98097730 None admin] RBAC: Authorizing `identity:get_user(user_id=b209a483d1084566a09bb6c4ec92134f)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:14.368075 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5924f997-173e-41c5-94c5-8d6b98097730 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:14.369794 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 65/130] 10.222.0.23 () {56 vars in 1177 bytes} [Sat Oct 1 20:32:14 2022] GET /identity/v3/users/b209a483d1084566a09bb6c4ec92134f => generated 275 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:14.370529 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5924f997-173e-41c5-94c5-8d6b98097730 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:14.370781 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969bc977-1e8f-436c-a88c-f1262a0f5b8a None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:14.475820 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5924f997-173e-41c5-94c5-8d6b98097730 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:14.481337 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b27074c-a1e7-4e60-8cca-2e004b75e1aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:14.481970 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b27074c-a1e7-4e60-8cca-2e004b75e1aa None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:14.482254 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b27074c-a1e7-4e60-8cca-2e004b75e1aa None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:14.482537 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b27074c-a1e7-4e60-8cca-2e004b75e1aa None admin] PATH_INFO: `/v3/roles` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:14.483208 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b27074c-a1e7-4e60-8cca-2e004b75e1aa None admin] RBAC: Adding query filter params (name=member) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:32:14.483511 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b27074c-a1e7-4e60-8cca-2e004b75e1aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:14.484935 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b27074c-a1e7-4e60-8cca-2e004b75e1aa None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:14.503373 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 66/131] 10.222.0.23 () {56 vars in 1101 bytes} [Sat Oct 1 20:32:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:14.504233 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b27074c-a1e7-4e60-8cca-2e004b75e1aa None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:14.504859 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:14.515540 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd11e3e5-cfc7-403f-a1d6-0b74b6f5d78f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:14.516204 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd11e3e5-cfc7-403f-a1d6-0b74b6f5d78f None admin] REQUEST_METHOD: `PUT` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:14.517311 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd11e3e5-cfc7-403f-a1d6-0b74b6f5d78f None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:14.517742 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd11e3e5-cfc7-403f-a1d6-0b74b6f5d78f None admin] PATH_INFO: `/v3/projects/754d04e2573f4c81b21775be5d8d103e/users/6d59f4f70f764f57b1d8cf05402fdf0e/roles/d11e7ba2f1fa41ff8ea8dda2a8d1466f` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:14.520139 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd11e3e5-cfc7-403f-a1d6-0b74b6f5d78f None admin] RBAC: Authorizing `identity:create_grant(project_id=754d04e2573f4c81b21775be5d8d103e, user_id=6d59f4f70f764f57b1d8cf05402fdf0e, role_id=d11e7ba2f1fa41ff8ea8dda2a8d1466f)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:14.521642 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd11e3e5-cfc7-403f-a1d6-0b74b6f5d78f None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:14.537801 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 66/132] 10.222.0.23 () {58 vars in 1439 bytes} [Sat Oct 1 20:32:14 2022] PUT /identity/v3/projects/754d04e2573f4c81b21775be5d8d103e/users/6d59f4f70f764f57b1d8cf05402fdf0e/roles/d11e7ba2f1fa41ff8ea8dda2a8d1466f => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 20:32:14.538642 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd11e3e5-cfc7-403f-a1d6-0b74b6f5d78f None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:14.741757 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd11e3e5-cfc7-403f-a1d6-0b74b6f5d78f None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:14.763908 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b27074c-a1e7-4e60-8cca-2e004b75e1aa None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:14.795012 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:14.834530 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729943a8-ccbc-44cb-967d-a69b2a568e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:14.835586 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729943a8-ccbc-44cb-967d-a69b2a568e2d None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:14.836080 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729943a8-ccbc-44cb-967d-a69b2a568e2d None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:14.836576 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729943a8-ccbc-44cb-967d-a69b2a568e2d None admin] PATH_INFO: `/v3/projects/754d04e2573f4c81b21775be5d8d103e` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:14.837967 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729943a8-ccbc-44cb-967d-a69b2a568e2d None admin] RBAC: Authorizing `identity:get_project(project_id=754d04e2573f4c81b21775be5d8d103e)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:14.839669 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729943a8-ccbc-44cb-967d-a69b2a568e2d None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:14.841826 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 67/133] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Oct 1 20:32:14 2022] GET /identity/v3/projects/754d04e2573f4c81b21775be5d8d103e => generated 298 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:14.849512 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f09241-db9f-4e9c-bd7b-b36ad9f55a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:14.850178 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f09241-db9f-4e9c-bd7b-b36ad9f55a82 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:14.850462 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f09241-db9f-4e9c-bd7b-b36ad9f55a82 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:14.850750 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f09241-db9f-4e9c-bd7b-b36ad9f55a82 None admin] PATH_INFO: `/v3/users/b209a483d1084566a09bb6c4ec92134f` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:14.851393 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729943a8-ccbc-44cb-967d-a69b2a568e2d None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:14.853198 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f09241-db9f-4e9c-bd7b-b36ad9f55a82 None admin] RBAC: Authorizing `identity:get_user(user_id=b209a483d1084566a09bb6c4ec92134f)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:14.854681 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f09241-db9f-4e9c-bd7b-b36ad9f55a82 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:14.856422 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 67/134] 10.222.0.23 () {56 vars in 1177 bytes} [Sat Oct 1 20:32:14 2022] GET /identity/v3/users/b209a483d1084566a09bb6c4ec92134f => generated 275 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:14.889377 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f09241-db9f-4e9c-bd7b-b36ad9f55a82 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:14.972944 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:15.016049 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729943a8-ccbc-44cb-967d-a69b2a568e2d None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:15.074888 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f09241-db9f-4e9c-bd7b-b36ad9f55a82 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:15.091603 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3595ca8-8772-40df-8212-7cc53d167fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:15.092283 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3595ca8-8772-40df-8212-7cc53d167fe1 None admin] REQUEST_METHOD: `PUT` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:15.092587 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3595ca8-8772-40df-8212-7cc53d167fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:15.092866 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3595ca8-8772-40df-8212-7cc53d167fe1 None admin] PATH_INFO: `/v3/projects/754d04e2573f4c81b21775be5d8d103e/users/b209a483d1084566a09bb6c4ec92134f/roles/8789e127ff4549b4883a92a87573ad3e` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:15.097458 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3595ca8-8772-40df-8212-7cc53d167fe1 None admin] RBAC: Authorizing `identity:create_grant(project_id=754d04e2573f4c81b21775be5d8d103e, user_id=b209a483d1084566a09bb6c4ec92134f, role_id=8789e127ff4549b4883a92a87573ad3e)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:15.098942 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3595ca8-8772-40df-8212-7cc53d167fe1 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:15.118772 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 68/135] 10.222.0.23 () {58 vars in 1439 bytes} [Sat Oct 1 20:32:14 2022] PUT /identity/v3/projects/754d04e2573f4c81b21775be5d8d103e/users/b209a483d1084566a09bb6c4ec92134f/roles/8789e127ff4549b4883a92a87573ad3e => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 20:32:15.136556 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eeaa17-2d0c-420b-9164-261e35a42f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:15.137246 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eeaa17-2d0c-420b-9164-261e35a42f50 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:15.137541 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eeaa17-2d0c-420b-9164-261e35a42f50 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:15.137804 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eeaa17-2d0c-420b-9164-261e35a42f50 None admin] PATH_INFO: `/v3/projects/0f5d7a8894224723b2e587bed1efaf3f` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:15.138994 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eeaa17-2d0c-420b-9164-261e35a42f50 None admin] RBAC: Authorizing `identity:get_project(project_id=0f5d7a8894224723b2e587bed1efaf3f)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:15.140460 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eeaa17-2d0c-420b-9164-261e35a42f50 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:15.142868 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 68/136] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Oct 1 20:32:14 2022] GET /identity/v3/projects/0f5d7a8894224723b2e587bed1efaf3f => generated 312 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:15.148926 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3595ca8-8772-40df-8212-7cc53d167fe1 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:15.202442 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:15.267788 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3595ca8-8772-40df-8212-7cc53d167fe1 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:15.311084 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad05ca3-dc80-4fe7-8b79-a5260464fd0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:15.311760 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad05ca3-dc80-4fe7-8b79-a5260464fd0a None admin] REQUEST_METHOD: `PUT` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:15.312044 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad05ca3-dc80-4fe7-8b79-a5260464fd0a None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:15.312336 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad05ca3-dc80-4fe7-8b79-a5260464fd0a None admin] PATH_INFO: `/v3/projects/0f5d7a8894224723b2e587bed1efaf3f/users/b209a483d1084566a09bb6c4ec92134f/roles/82138515a02147ccb30f8d56863aab87` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:15.314626 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad05ca3-dc80-4fe7-8b79-a5260464fd0a None admin] RBAC: Authorizing `identity:create_grant(project_id=0f5d7a8894224723b2e587bed1efaf3f, user_id=b209a483d1084566a09bb6c4ec92134f, role_id=82138515a02147ccb30f8d56863aab87)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:15.316114 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad05ca3-dc80-4fe7-8b79-a5260464fd0a None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:15.336803 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 69/137] 10.222.0.23 () {58 vars in 1439 bytes} [Sat Oct 1 20:32:15 2022] PUT /identity/v3/projects/0f5d7a8894224723b2e587bed1efaf3f/users/b209a483d1084566a09bb6c4ec92134f/roles/82138515a02147ccb30f8d56863aab87 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 20:32:15.589858 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68735f8-1ccd-4151-b04e-81d9a56164ad None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:15.590361 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68735f8-1ccd-4151-b04e-81d9a56164ad None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:15.590672 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68735f8-1ccd-4151-b04e-81d9a56164ad None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:15.592311 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 69/138] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:32:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:32:15.599614 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e444b51-bfc2-4550-b071-1176b16c8b23 None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:15.600095 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e444b51-bfc2-4550-b071-1176b16c8b23 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:15.600167 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e444b51-bfc2-4550-b071-1176b16c8b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:15.621292 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-4e444b51-bfc2-4550-b071-1176b16c8b23 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:32:15.622529 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-4e444b51-bfc2-4550-b071-1176b16c8b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:32:15.721960 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 70/139] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:32:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 20:32:16.103794 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e380c5a-fbfd-49b9-9618-d0e4659c2310 None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:16.104187 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e380c5a-fbfd-49b9-9618-d0e4659c2310 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:16.104368 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e380c5a-fbfd-49b9-9618-d0e4659c2310 None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:16.105732 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 70/140] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:32:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:32:16.122107 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8e356-a44e-4d7c-8600-2ba96b107967 None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:16.122397 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8e356-a44e-4d7c-8600-2ba96b107967 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:16.122675 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8e356-a44e-4d7c-8600-2ba96b107967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:16.149556 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-4ed8e356-a44e-4d7c-8600-2ba96b107967 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:32:16.150760 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-4ed8e356-a44e-4d7c-8600-2ba96b107967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:32:16.186653 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e380c5a-fbfd-49b9-9618-d0e4659c2310 None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:16.198065 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:16.271190 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 71/141] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:32:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 20:32:16.362079 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e380c5a-fbfd-49b9-9618-d0e4659c2310 None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:16.369913 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:16.398320 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5463337-12b5-43d6-a16d-8661a3b1b58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:16.398952 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5463337-12b5-43d6-a16d-8661a3b1b58b None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:16.399230 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5463337-12b5-43d6-a16d-8661a3b1b58b None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:16.399501 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5463337-12b5-43d6-a16d-8661a3b1b58b None admin] PATH_INFO: `/v3/domains/default` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:16.400683 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5463337-12b5-43d6-a16d-8661a3b1b58b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:16.402143 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5463337-12b5-43d6-a16d-8661a3b1b58b None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:16.404115 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 71/142] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Oct 1 20:32:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:16.413914 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed8e356-a44e-4d7c-8600-2ba96b107967 None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:16.496463 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29840c1c-7198-4293-8996-3080d6ac9cb2 None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:16.496806 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29840c1c-7198-4293-8996-3080d6ac9cb2 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:16.497044 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29840c1c-7198-4293-8996-3080d6ac9cb2 None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:16.498752 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 72/143] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:32:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:32:16.504255 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cd4f7d-9dde-444a-a5b0-fac8cd8aeaf4 None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:16.504557 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cd4f7d-9dde-444a-a5b0-fac8cd8aeaf4 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:16.504844 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cd4f7d-9dde-444a-a5b0-fac8cd8aeaf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:16.539338 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-97cd4f7d-9dde-444a-a5b0-fac8cd8aeaf4 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:32:16.540549 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-97cd4f7d-9dde-444a-a5b0-fac8cd8aeaf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:32:16.606763 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed8e356-a44e-4d7c-8600-2ba96b107967 None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:16.680368 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577f686d-b2a3-470f-aca0-84f3f64a1b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:16.680928 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577f686d-b2a3-470f-aca0-84f3f64a1b53 None admin] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:16.681204 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577f686d-b2a3-470f-aca0-84f3f64a1b53 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:16.681472 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577f686d-b2a3-470f-aca0-84f3f64a1b53 None admin] PATH_INFO: `/v3/users` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:16.682126 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577f686d-b2a3-470f-aca0-84f3f64a1b53 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:16.683575 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577f686d-b2a3-470f-aca0-84f3f64a1b53 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:16.711163 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 73/144] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:32:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 01 20:32:16.727112 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 72/145] 10.222.0.23 () {60 vars in 1132 bytes} [Sat Oct 1 20:32:16 2022] POST /identity/v3/users => generated 283 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 20:32:16.878474 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cd4f7d-9dde-444a-a5b0-fac8cd8aeaf4 None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:17.011861 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cd4f7d-9dde-444a-a5b0-fac8cd8aeaf4 None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:17.014341 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:17.058254 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea21ba5-91b9-4a41-9e20-9f0695e34ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:17.058914 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea21ba5-91b9-4a41-9e20-9f0695e34ba8 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:17.059194 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea21ba5-91b9-4a41-9e20-9f0695e34ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:17.059467 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea21ba5-91b9-4a41-9e20-9f0695e34ba8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:17.074992 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea21ba5-91b9-4a41-9e20-9f0695e34ba8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 20:32:17.080348 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-8ea21ba5-91b9-4a41-9e20-9f0695e34ba8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 01 20:32:17.080348 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:32:17.080348 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:32:17.080348 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:32:17.080348 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:32:17.080348 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:32:17.080348 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:32:17.080348 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:32:17.080348 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:32:17.080348 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:32:17.080348 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:32:17.080348 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:32:17.080348 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 20:32:17.080348 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 20:32:17.080348 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 20:32:17.080348 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 20:32:17.081651 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 20:32:17.081651 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 20:32:17.081651 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 20:32:17.081651 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 20:32:17.081651 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:32:17.081651 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:32:17.081651 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:32:17.081651 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:32:17.081651 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:32:17.081651 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:32:17.081651 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:32:17.081651 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:32:17.081651 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:32:17.081651 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:32:17.081651 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:32:17.081651 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:32:17.082406 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:32:17.082406 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:32:17.082406 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:32:17.082406 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:32:17.082406 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 20:32:17.082406 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 20:32:17.082406 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 20:32:17.082406 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 20:32:17.082406 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 20:32:17.082406 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 20:32:17.082406 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 01 20:32:17.082406 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:32:17.082406 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 74/146] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Oct 1 20:32:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:32:17.089429 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577f686d-b2a3-470f-aca0-84f3f64a1b53 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:17.124102 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:17.128599 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea21ba5-91b9-4a41-9e20-9f0695e34ba8 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:17.237623 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577f686d-b2a3-470f-aca0-84f3f64a1b53 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:17.297995 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea21ba5-91b9-4a41-9e20-9f0695e34ba8 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:17.305206 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a740b1a3-e4a3-4c69-8d46-72ad7583b8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:17.305881 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740b1a3-e4a3-4c69-8d46-72ad7583b8b8 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:17.306159 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740b1a3-e4a3-4c69-8d46-72ad7583b8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:17.306428 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740b1a3-e4a3-4c69-8d46-72ad7583b8b8 None admin] PATH_INFO: `/v3/roles` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:17.307092 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a740b1a3-e4a3-4c69-8d46-72ad7583b8b8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:32:17.307389 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a740b1a3-e4a3-4c69-8d46-72ad7583b8b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:17.308815 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a740b1a3-e4a3-4c69-8d46-72ad7583b8b8 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:17.330120 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 73/147] 10.222.0.23 () {56 vars in 1101 bytes} [Sat Oct 1 20:32:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:17.334059 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a740b1a3-e4a3-4c69-8d46-72ad7583b8b8 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:17.371954 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440d5d8d-4b04-4afe-a4da-89c68f49b8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:17.372867 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d5d8d-4b04-4afe-a4da-89c68f49b8f3 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:17.373066 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d5d8d-4b04-4afe-a4da-89c68f49b8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:17.373290 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d5d8d-4b04-4afe-a4da-89c68f49b8f3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:17.396687 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440d5d8d-4b04-4afe-a4da-89c68f49b8f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 20:32:17.402644 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-440d5d8d-4b04-4afe-a4da-89c68f49b8f3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 01 20:32:17.402644 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:32:17.402644 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:32:17.402644 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:32:17.402644 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:32:17.402644 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:32:17.402644 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:32:17.402644 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:32:17.402644 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:32:17.402644 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:32:17.402644 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:32:17.402644 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:32:17.402644 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 20:32:17.402644 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 20:32:17.402644 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 20:32:17.402644 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 20:32:17.403507 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 20:32:17.403507 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 20:32:17.403507 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 20:32:17.403507 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 20:32:17.403507 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:32:17.403507 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:32:17.403507 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:32:17.403507 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:32:17.403507 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:32:17.403507 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:32:17.403507 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:32:17.403507 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:32:17.403507 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:32:17.403507 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:32:17.403507 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:32:17.403507 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:32:17.404272 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:32:17.404272 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:32:17.404272 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:32:17.404272 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:32:17.404272 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 20:32:17.404272 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 20:32:17.404272 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 20:32:17.404272 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 20:32:17.404272 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 20:32:17.404272 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 20:32:17.404272 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 01 20:32:17.404272 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:32:17.408085 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 75/148] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Oct 1 20:32:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 01 20:32:17.414227 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440d5d8d-4b04-4afe-a4da-89c68f49b8f3 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:17.449088 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:17.490336 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:17.531363 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a740b1a3-e4a3-4c69-8d46-72ad7583b8b8 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:17.587428 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440d5d8d-4b04-4afe-a4da-89c68f49b8f3 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:17.609266 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e9c5f4-3811-4912-9e78-65b249328fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:17.609987 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9c5f4-3811-4912-9e78-65b249328fff None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:17.610250 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9c5f4-3811-4912-9e78-65b249328fff None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:17.610479 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9c5f4-3811-4912-9e78-65b249328fff None admin] PATH_INFO: `/v3/users/2bb3ed388eb64483a07605d22e91f089` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:17.611668 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e9c5f4-3811-4912-9e78-65b249328fff None admin] RBAC: Authorizing `identity:get_user(user_id=2bb3ed388eb64483a07605d22e91f089)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:17.613462 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e9c5f4-3811-4912-9e78-65b249328fff None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:17.615020 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 74/149] 10.222.0.23 () {56 vars in 1177 bytes} [Sat Oct 1 20:32:17 2022] GET /identity/v3/users/2bb3ed388eb64483a07605d22e91f089 => generated 289 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 20:32:17.621188 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e9c5f4-3811-4912-9e78-65b249328fff None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:17.653176 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b59557-e69f-4f2d-a4a4-5653a26dd131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:17.653787 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b59557-e69f-4f2d-a4a4-5653a26dd131 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:17.654062 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b59557-e69f-4f2d-a4a4-5653a26dd131 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:17.654327 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b59557-e69f-4f2d-a4a4-5653a26dd131 None admin] PATH_INFO: `/v3/roles` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:17.654987 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b59557-e69f-4f2d-a4a4-5653a26dd131 None admin] RBAC: Adding query filter params (name=member) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:32:17.655281 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b59557-e69f-4f2d-a4a4-5653a26dd131 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:17.656680 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b59557-e69f-4f2d-a4a4-5653a26dd131 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:17.672284 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 76/150] 10.222.0.23 () {56 vars in 1101 bytes} [Sat Oct 1 20:32:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 20:32:17.678411 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b59557-e69f-4f2d-a4a4-5653a26dd131 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:17.784168 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:17.804841 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b59557-e69f-4f2d-a4a4-5653a26dd131 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:17.856502 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4285631-258a-4746-af17-0c6c0fb0bb21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:17.857119 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4285631-258a-4746-af17-0c6c0fb0bb21 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:17.858007 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4285631-258a-4746-af17-0c6c0fb0bb21 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:17.858338 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4285631-258a-4746-af17-0c6c0fb0bb21 None admin] PATH_INFO: `/v3/users/b209a483d1084566a09bb6c4ec92134f` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:17.859601 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4285631-258a-4746-af17-0c6c0fb0bb21 None admin] RBAC: Authorizing `identity:get_user(user_id=b209a483d1084566a09bb6c4ec92134f)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:17.862329 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4285631-258a-4746-af17-0c6c0fb0bb21 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:17.864771 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 77/151] 10.222.0.23 () {56 vars in 1177 bytes} [Sat Oct 1 20:32:17 2022] GET /identity/v3/users/b209a483d1084566a09bb6c4ec92134f => generated 275 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:17.873353 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e9c5f4-3811-4912-9e78-65b249328fff None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:17.902579 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4285631-258a-4746-af17-0c6c0fb0bb21 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:17.931662 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c32a0c8-3ed8-4985-8d30-baf27c35c521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:17.934972 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32a0c8-3ed8-4985-8d30-baf27c35c521 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:17.935248 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32a0c8-3ed8-4985-8d30-baf27c35c521 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:17.935570 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32a0c8-3ed8-4985-8d30-baf27c35c521 None admin] PATH_INFO: `/v3/projects/754d04e2573f4c81b21775be5d8d103e` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:17.938542 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c32a0c8-3ed8-4985-8d30-baf27c35c521 None admin] RBAC: Authorizing `identity:get_project(project_id=754d04e2573f4c81b21775be5d8d103e)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:17.940020 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c32a0c8-3ed8-4985-8d30-baf27c35c521 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:17.944614 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 75/152] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Oct 1 20:32:17 2022] GET /identity/v3/projects/754d04e2573f4c81b21775be5d8d103e => generated 298 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:17.950941 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c32a0c8-3ed8-4985-8d30-baf27c35c521 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:17.981190 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:18.092842 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c32a0c8-3ed8-4985-8d30-baf27c35c521 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:18.103774 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4285631-258a-4746-af17-0c6c0fb0bb21 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:18.131995 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f5c8c3-eebc-4c22-aa8b-3ea261008579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:18.132738 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5c8c3-eebc-4c22-aa8b-3ea261008579 None admin] REQUEST_METHOD: `PUT` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:18.133012 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5c8c3-eebc-4c22-aa8b-3ea261008579 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:18.133337 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5c8c3-eebc-4c22-aa8b-3ea261008579 None admin] PATH_INFO: `/v3/projects/754d04e2573f4c81b21775be5d8d103e/users/2bb3ed388eb64483a07605d22e91f089/roles/593409d904954a0f8039eda5aa05fc40` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:18.135409 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f5c8c3-eebc-4c22-aa8b-3ea261008579 None admin] RBAC: Authorizing `identity:create_grant(project_id=754d04e2573f4c81b21775be5d8d103e, user_id=2bb3ed388eb64483a07605d22e91f089, role_id=593409d904954a0f8039eda5aa05fc40)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:18.137054 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f5c8c3-eebc-4c22-aa8b-3ea261008579 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:18.151466 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 76/153] 10.222.0.23 () {58 vars in 1439 bytes} [Sat Oct 1 20:32:17 2022] PUT /identity/v3/projects/754d04e2573f4c81b21775be5d8d103e/users/2bb3ed388eb64483a07605d22e91f089/roles/593409d904954a0f8039eda5aa05fc40 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 01 20:32:18.166029 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2792fb89-6b39-4e9f-953a-2482f910b80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:18.166667 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792fb89-6b39-4e9f-953a-2482f910b80b None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:18.166945 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792fb89-6b39-4e9f-953a-2482f910b80b None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:18.167216 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792fb89-6b39-4e9f-953a-2482f910b80b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:18.210955 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:18.270613 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2792fb89-6b39-4e9f-953a-2482f910b80b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:18.272103 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2792fb89-6b39-4e9f-953a-2482f910b80b None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:18.397709 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 78/154] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Oct 1 20:32:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 01 20:32:18.403520 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f5c8c3-eebc-4c22-aa8b-3ea261008579 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:18.570953 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:18.616939 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f5c8c3-eebc-4c22-aa8b-3ea261008579 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:18.660472 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd8cba6-80e4-4b2f-b776-e5ecd27f1ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:18.661473 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd8cba6-80e4-4b2f-b776-e5ecd27f1ee8 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:18.661947 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd8cba6-80e4-4b2f-b776-e5ecd27f1ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:18.662431 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd8cba6-80e4-4b2f-b776-e5ecd27f1ee8 None admin] PATH_INFO: `/v3/projects/754d04e2573f4c81b21775be5d8d103e` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:18.663794 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd8cba6-80e4-4b2f-b776-e5ecd27f1ee8 None admin] RBAC: Authorizing `identity:get_project(project_id=754d04e2573f4c81b21775be5d8d103e)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:18.665479 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd8cba6-80e4-4b2f-b776-e5ecd27f1ee8 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:18.667302 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 77/155] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Oct 1 20:32:18 2022] GET /identity/v3/projects/754d04e2573f4c81b21775be5d8d103e => generated 298 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:18.673919 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2792fb89-6b39-4e9f-953a-2482f910b80b None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:18.699948 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8dc278-d263-40cc-987f-9dd14f47dc5b None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:18.700592 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8dc278-d263-40cc-987f-9dd14f47dc5b None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:18.701104 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8dc278-d263-40cc-987f-9dd14f47dc5b None None] PATH_INFO: `/` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:18.702740 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 78/156] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:32:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:32:18.710953 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1527c0c-2b79-4506-9ef2-8c2ce460cd54 None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:18.711544 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1527c0c-2b79-4506-9ef2-8c2ce460cd54 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:18.712015 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1527c0c-2b79-4506-9ef2-8c2ce460cd54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:18.749536 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-c1527c0c-2b79-4506-9ef2-8c2ce460cd54 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:32:18.751425 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-c1527c0c-2b79-4506-9ef2-8c2ce460cd54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:32:18.760558 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:18.831756 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2792fb89-6b39-4e9f-953a-2482f910b80b None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:18.836003 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 79/157] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:32:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 01 20:32:18.884009 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d76083d-23ae-4fc8-839a-bfeaec6dfcb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:18.884640 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d76083d-23ae-4fc8-839a-bfeaec6dfcb3 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:18.884919 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d76083d-23ae-4fc8-839a-bfeaec6dfcb3 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:18.885189 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d76083d-23ae-4fc8-839a-bfeaec6dfcb3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:18.885905 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d76083d-23ae-4fc8-839a-bfeaec6dfcb3 None admin] RBAC: Adding query filter params (role.id=82138515a02147ccb30f8d56863aab87, scope.project.id=754d04e2573f4c81b21775be5d8d103e, user.id=b209a483d1084566a09bb6c4ec92134f) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:32:18.886207 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d76083d-23ae-4fc8-839a-bfeaec6dfcb3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:18.887646 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d76083d-23ae-4fc8-839a-bfeaec6dfcb3 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:18.894712 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 79/158] 10.222.0.23 () {56 vars in 1374 bytes} [Sat Oct 1 20:32:18 2022] GET /identity/v3/role_assignments?user.id=b209a483d1084566a09bb6c4ec92134f&scope.project.id=754d04e2573f4c81b21775be5d8d103e&role.id=82138515a02147ccb30f8d56863aab87 => generated 608 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:19.140345 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a45d7c-4a53-46d7-821d-90ad78fad2aa None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:19.140871 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a45d7c-4a53-46d7-821d-90ad78fad2aa None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:19.141321 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a45d7c-4a53-46d7-821d-90ad78fad2aa None None] PATH_INFO: `/` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:19.143195 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 80/159] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:32:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:32:19.153965 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534cef0-b203-4f3d-adf9-8da551eb3cee None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:19.154253 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534cef0-b203-4f3d-adf9-8da551eb3cee None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:19.154521 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534cef0-b203-4f3d-adf9-8da551eb3cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:19.182187 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-b534cef0-b203-4f3d-adf9-8da551eb3cee None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:32:19.184130 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-b534cef0-b203-4f3d-adf9-8da551eb3cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:32:19.283673 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 80/160] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:32:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 20:32:19.454941 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a45d7c-4a53-46d7-821d-90ad78fad2aa None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:19.561621 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:19.592372 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a45d7c-4a53-46d7-821d-90ad78fad2aa None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:19.638829 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c661894-c81b-494a-86bc-e3f9eafbb350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:19.639842 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c661894-c81b-494a-86bc-e3f9eafbb350 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:19.639842 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c661894-c81b-494a-86bc-e3f9eafbb350 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:19.640137 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c661894-c81b-494a-86bc-e3f9eafbb350 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:19.642584 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9b728-14ff-44f4-82f0-621557c5f340 None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:19.642872 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9b728-14ff-44f4-82f0-621557c5f340 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:19.643141 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9b728-14ff-44f4-82f0-621557c5f340 None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:19.644638 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 81/161] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:32:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:32:19.653579 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c661894-c81b-494a-86bc-e3f9eafbb350 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 20:32:19.653811 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b3f65-e6f0-4f13-9a3f-20a1365041c9 None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:19.654039 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b3f65-e6f0-4f13-9a3f-20a1365041c9 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:19.654311 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b3f65-e6f0-4f13-9a3f-20a1365041c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:19.660773 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application [None req-6c661894-c81b-494a-86bc-e3f9eafbb350 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 20:32:19.660773 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:32:19.660773 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:32:19.660773 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:32:19.660773 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:32:19.660773 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:32:19.660773 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:32:19.660773 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:32:19.660773 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:32:19.660773 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:32:19.660773 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:32:19.660773 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:32:19.660773 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 20:32:19.660773 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 20:32:19.660773 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 20:32:19.660773 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 20:32:19.661649 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 20:32:19.661649 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 20:32:19.661649 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 20:32:19.661649 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 20:32:19.661649 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:32:19.661649 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:32:19.661649 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:32:19.661649 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:32:19.661649 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:32:19.661649 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:32:19.661649 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:32:19.661649 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application with Lock( Oct 01 20:32:19.661649 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:32:19.661649 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:32:19.661649 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:32:19.661649 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:32:19.662448 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:32:19.662448 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:32:19.662448 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:32:19.662448 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:32:19.662448 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 20:32:19.662448 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 20:32:19.662448 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 20:32:19.662448 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 20:32:19.662448 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 20:32:19.662448 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 20:32:19.662448 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 20:32:19.662448 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:32:19.662448 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 81/162] 10.222.0.23 () {56 vars in 1096 bytes} [Sat Oct 1 20:32:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:32:19.669169 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c661894-c81b-494a-86bc-e3f9eafbb350 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:19.691466 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-f41b3f65-e6f0-4f13-9a3f-20a1365041c9 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:32:19.692684 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-f41b3f65-e6f0-4f13-9a3f-20a1365041c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:32:19.768996 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:19.811218 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c661894-c81b-494a-86bc-e3f9eafbb350 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:19.826060 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 82/163] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:32:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 20:32:19.857236 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed1270-1e7b-482d-a37b-0fbeb150c957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:19.857845 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed1270-1e7b-482d-a37b-0fbeb150c957 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:19.858117 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed1270-1e7b-482d-a37b-0fbeb150c957 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:19.858384 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed1270-1e7b-482d-a37b-0fbeb150c957 None admin] PATH_INFO: `/v3/roles` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:19.859050 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ed1270-1e7b-482d-a37b-0fbeb150c957 None admin] RBAC: Adding query filter params (name=admin) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:32:19.859383 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ed1270-1e7b-482d-a37b-0fbeb150c957 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:19.860991 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ed1270-1e7b-482d-a37b-0fbeb150c957 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:19.870023 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 82/164] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Oct 1 20:32:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:19.870588 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:19.881646 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41b3f65-e6f0-4f13-9a3f-20a1365041c9 None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:19.940552 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed1270-1e7b-482d-a37b-0fbeb150c957 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:20.049380 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41b3f65-e6f0-4f13-9a3f-20a1365041c9 None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:20.101004 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed1270-1e7b-482d-a37b-0fbeb150c957 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:20.133262 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5baedd0-d2a7-4a6c-9548-161a37c072ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:20.133915 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5baedd0-d2a7-4a6c-9548-161a37c072ee None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:20.134192 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5baedd0-d2a7-4a6c-9548-161a37c072ee None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:20.134467 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5baedd0-d2a7-4a6c-9548-161a37c072ee None admin] PATH_INFO: `/v3/users/6d59f4f70f764f57b1d8cf05402fdf0e` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:20.137187 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5baedd0-d2a7-4a6c-9548-161a37c072ee None admin] RBAC: Authorizing `identity:get_user(user_id=6d59f4f70f764f57b1d8cf05402fdf0e)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:20.138687 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5baedd0-d2a7-4a6c-9548-161a37c072ee None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:20.140215 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 83/165] 10.222.0.23 () {56 vars in 1177 bytes} [Sat Oct 1 20:32:19 2022] GET /identity/v3/users/6d59f4f70f764f57b1d8cf05402fdf0e => generated 247 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:20.148223 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5baedd0-d2a7-4a6c-9548-161a37c072ee None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:20.176563 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12ffbfe-8059-4efe-84f5-47eaefbf7d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:20.176563 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ffbfe-8059-4efe-84f5-47eaefbf7d55 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:20.176563 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ffbfe-8059-4efe-84f5-47eaefbf7d55 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:20.176563 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ffbfe-8059-4efe-84f5-47eaefbf7d55 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:20.209492 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12ffbfe-8059-4efe-84f5-47eaefbf7d55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 20:32:20.214985 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application [None req-c12ffbfe-8059-4efe-84f5-47eaefbf7d55 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 01 20:32:20.214985 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:32:20.214985 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:32:20.214985 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:32:20.214985 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:32:20.214985 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:32:20.214985 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:32:20.214985 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:32:20.214985 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:32:20.214985 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:32:20.214985 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:32:20.214985 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:32:20.214985 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 20:32:20.214985 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 20:32:20.214985 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 20:32:20.214985 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 20:32:20.215886 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 20:32:20.215886 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 20:32:20.215886 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 20:32:20.215886 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 20:32:20.215886 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:32:20.215886 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:32:20.215886 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:32:20.215886 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:32:20.215886 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:32:20.215886 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:32:20.215886 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:32:20.215886 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application with Lock( Oct 01 20:32:20.215886 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:32:20.215886 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:32:20.215886 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:32:20.215886 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:32:20.216953 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:32:20.216953 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:32:20.216953 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:32:20.216953 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:32:20.216953 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 20:32:20.216953 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 20:32:20.216953 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 20:32:20.216953 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 20:32:20.216953 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 20:32:20.216953 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 20:32:20.216953 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 01 20:32:20.216953 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:32:20.216953 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 83/166] 10.222.0.23 () {56 vars in 1114 bytes} [Sat Oct 1 20:32:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:32:20.225542 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12ffbfe-8059-4efe-84f5-47eaefbf7d55 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:20.226091 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:20.297808 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5baedd0-d2a7-4a6c-9548-161a37c072ee None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:20.354704 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8f9991-dc31-4984-a44e-96e0f68fe951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:20.355229 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f9991-dc31-4984-a44e-96e0f68fe951 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:20.355504 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f9991-dc31-4984-a44e-96e0f68fe951 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:20.355775 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f9991-dc31-4984-a44e-96e0f68fe951 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:20.382237 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:20.458763 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8f9991-dc31-4984-a44e-96e0f68fe951 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:20.460265 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8f9991-dc31-4984-a44e-96e0f68fe951 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:20.511402 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12ffbfe-8059-4efe-84f5-47eaefbf7d55 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:20.537853 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:20.600142 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 84/167] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Oct 1 20:32:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 01 20:32:20.601016 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8f9991-dc31-4984-a44e-96e0f68fe951 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:20.601729 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ff5823-cbc6-478e-b121-eae2314216f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:20.602681 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ff5823-cbc6-478e-b121-eae2314216f4 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:20.602967 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ff5823-cbc6-478e-b121-eae2314216f4 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:20.603241 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ff5823-cbc6-478e-b121-eae2314216f4 None admin] PATH_INFO: `/v3/roles` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:20.603912 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ff5823-cbc6-478e-b121-eae2314216f4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:32:20.604212 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ff5823-cbc6-478e-b121-eae2314216f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:20.605679 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ff5823-cbc6-478e-b121-eae2314216f4 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:20.628051 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 84/168] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Oct 1 20:32:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:20.628957 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ff5823-cbc6-478e-b121-eae2314216f4 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:20.815222 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8f9991-dc31-4984-a44e-96e0f68fe951 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:20.856256 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ff5823-cbc6-478e-b121-eae2314216f4 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:20.887041 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374b26c3-72eb-403f-9c7b-a1f9c78cb5dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:20.887699 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374b26c3-72eb-403f-9c7b-a1f9c78cb5dc None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:20.887904 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:20.888004 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374b26c3-72eb-403f-9c7b-a1f9c78cb5dc None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:20.888201 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374b26c3-72eb-403f-9c7b-a1f9c78cb5dc None admin] PATH_INFO: `/v3/roles/member` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:20.905927 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374b26c3-72eb-403f-9c7b-a1f9c78cb5dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 20:32:20.918305 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-374b26c3-72eb-403f-9c7b-a1f9c78cb5dc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 01 20:32:20.918305 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:32:20.918305 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:32:20.918305 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:32:20.918305 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:32:20.918305 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:32:20.918305 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:32:20.918305 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:32:20.918305 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:32:20.918305 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:32:20.918305 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:32:20.918305 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:32:20.918305 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 20:32:20.918305 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 20:32:20.918305 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 20:32:20.918305 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 20:32:20.919329 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 20:32:20.919329 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 20:32:20.919329 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 20:32:20.919329 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 20:32:20.919329 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:32:20.919329 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:32:20.919329 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:32:20.919329 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:32:20.919329 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:32:20.919329 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:32:20.919329 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:32:20.919329 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:32:20.919329 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:32:20.919329 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:32:20.919329 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:32:20.919329 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:32:20.920107 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:32:20.920107 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:32:20.920107 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:32:20.920107 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:32:20.920107 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 20:32:20.920107 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 20:32:20.920107 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 20:32:20.920107 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 20:32:20.920107 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 20:32:20.920107 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 20:32:20.920107 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 01 20:32:20.920107 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:32:20.924238 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3a6ca5-858d-4abd-9d25-c57ee7218c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:20.924917 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a6ca5-858d-4abd-9d25-c57ee7218c0c None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:20.925197 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a6ca5-858d-4abd-9d25-c57ee7218c0c None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:20.925474 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a6ca5-858d-4abd-9d25-c57ee7218c0c None admin] PATH_INFO: `/v3/projects/754d04e2573f4c81b21775be5d8d103e` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:20.926625 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3a6ca5-858d-4abd-9d25-c57ee7218c0c None admin] RBAC: Authorizing `identity:get_project(project_id=754d04e2573f4c81b21775be5d8d103e)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:20.928084 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3a6ca5-858d-4abd-9d25-c57ee7218c0c None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:20.929741 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 85/169] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Oct 1 20:32:20 2022] GET /identity/v3/projects/754d04e2573f4c81b21775be5d8d103e => generated 298 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:20.930505 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3a6ca5-858d-4abd-9d25-c57ee7218c0c None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:20.931069 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 85/170] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Oct 1 20:32:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:32:20.931962 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374b26c3-72eb-403f-9c7b-a1f9c78cb5dc None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:20.954493 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:21.117523 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3a6ca5-858d-4abd-9d25-c57ee7218c0c None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:21.125598 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374b26c3-72eb-403f-9c7b-a1f9c78cb5dc None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:21.180542 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b859629-d667-4d6f-af10-81c6a338de15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:21.181165 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b859629-d667-4d6f-af10-81c6a338de15 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:21.181444 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b859629-d667-4d6f-af10-81c6a338de15 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:21.181718 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b859629-d667-4d6f-af10-81c6a338de15 None admin] PATH_INFO: `/v3/users/b209a483d1084566a09bb6c4ec92134f` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:21.182944 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b859629-d667-4d6f-af10-81c6a338de15 None admin] RBAC: Authorizing `identity:get_user(user_id=b209a483d1084566a09bb6c4ec92134f)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:21.184418 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b859629-d667-4d6f-af10-81c6a338de15 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:21.186020 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 86/171] 10.222.0.23 () {56 vars in 1177 bytes} [Sat Oct 1 20:32:20 2022] GET /identity/v3/users/b209a483d1084566a09bb6c4ec92134f => generated 275 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:21.186782 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b859629-d667-4d6f-af10-81c6a338de15 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:21.205424 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a455c58-935c-4bfb-a54f-8b11a01adcb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:21.206042 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a455c58-935c-4bfb-a54f-8b11a01adcb2 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:21.206324 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a455c58-935c-4bfb-a54f-8b11a01adcb2 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:21.206598 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a455c58-935c-4bfb-a54f-8b11a01adcb2 None admin] PATH_INFO: `/v3/roles` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:21.207276 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a455c58-935c-4bfb-a54f-8b11a01adcb2 None admin] RBAC: Adding query filter params (name=member) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:32:21.207582 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a455c58-935c-4bfb-a54f-8b11a01adcb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:21.209042 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a455c58-935c-4bfb-a54f-8b11a01adcb2 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:21.240636 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 86/172] 10.222.0.23 () {56 vars in 1101 bytes} [Sat Oct 1 20:32:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:21.241536 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a455c58-935c-4bfb-a54f-8b11a01adcb2 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:21.341837 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:21.351560 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:21.395231 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a455c58-935c-4bfb-a54f-8b11a01adcb2 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:21.437524 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e7a43a-85c9-441c-9af9-9c6dc072244f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:21.438822 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e7a43a-85c9-441c-9af9-9c6dc072244f None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:21.441944 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e7a43a-85c9-441c-9af9-9c6dc072244f None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:21.442255 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e7a43a-85c9-441c-9af9-9c6dc072244f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:21.458804 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b859629-d667-4d6f-af10-81c6a338de15 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:21.532572 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a66ac3-3bbf-47f7-a48f-c34c6d8a2784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:21.533223 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a66ac3-3bbf-47f7-a48f-c34c6d8a2784 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:21.533504 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a66ac3-3bbf-47f7-a48f-c34c6d8a2784 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:21.533779 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a66ac3-3bbf-47f7-a48f-c34c6d8a2784 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:21.534510 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a66ac3-3bbf-47f7-a48f-c34c6d8a2784 None admin] RBAC: Adding query filter params (role.id=d11e7ba2f1fa41ff8ea8dda2a8d1466f, scope.project.id=754d04e2573f4c81b21775be5d8d103e, user.id=6d59f4f70f764f57b1d8cf05402fdf0e) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:32:21.534818 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a66ac3-3bbf-47f7-a48f-c34c6d8a2784 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:21.536286 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a66ac3-3bbf-47f7-a48f-c34c6d8a2784 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:21.552736 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 87/173] 10.222.0.23 () {56 vars in 1374 bytes} [Sat Oct 1 20:32:21 2022] GET /identity/v3/role_assignments?user.id=6d59f4f70f764f57b1d8cf05402fdf0e&scope.project.id=754d04e2573f4c81b21775be5d8d103e&role.id=d11e7ba2f1fa41ff8ea8dda2a8d1466f => generated 608 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:21.553578 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a66ac3-3bbf-47f7-a48f-c34c6d8a2784 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:21.596793 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e7a43a-85c9-441c-9af9-9c6dc072244f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:21.600635 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e7a43a-85c9-441c-9af9-9c6dc072244f None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:21.724229 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a66ac3-3bbf-47f7-a48f-c34c6d8a2784 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:21.751321 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:21.767496 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:21.777081 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cf5878-44df-4029-89da-b207d07531f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:21.777731 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cf5878-44df-4029-89da-b207d07531f0 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:21.778010 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cf5878-44df-4029-89da-b207d07531f0 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:21.778280 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cf5878-44df-4029-89da-b207d07531f0 None admin] PATH_INFO: `/v3/users/b209a483d1084566a09bb6c4ec92134f` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:21.780510 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cf5878-44df-4029-89da-b207d07531f0 None admin] RBAC: Authorizing `identity:get_user(user_id=b209a483d1084566a09bb6c4ec92134f)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:21.782143 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cf5878-44df-4029-89da-b207d07531f0 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:21.783868 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 88/174] 10.222.0.23 () {56 vars in 1177 bytes} [Sat Oct 1 20:32:21 2022] GET /identity/v3/users/b209a483d1084566a09bb6c4ec92134f => generated 275 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:21.790575 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cf5878-44df-4029-89da-b207d07531f0 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:21.855902 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 87/175] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Oct 1 20:32:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 615 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 01 20:32:21.862123 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e7a43a-85c9-441c-9af9-9c6dc072244f None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:21.919673 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cf5878-44df-4029-89da-b207d07531f0 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:21.967695 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b971143d-9c59-42ee-8016-d82bd4b5f759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:21.968725 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b971143d-9c59-42ee-8016-d82bd4b5f759 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:21.969216 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b971143d-9c59-42ee-8016-d82bd4b5f759 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:21.969454 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b971143d-9c59-42ee-8016-d82bd4b5f759 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:22.036315 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:22.055027 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b971143d-9c59-42ee-8016-d82bd4b5f759 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:22.057272 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b971143d-9c59-42ee-8016-d82bd4b5f759 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:22.087335 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e7a43a-85c9-441c-9af9-9c6dc072244f None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:22.133704 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7051c003-739a-455c-bfd5-af5e883b6a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:22.134710 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051c003-739a-455c-bfd5-af5e883b6a8d None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:22.135189 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051c003-739a-455c-bfd5-af5e883b6a8d None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:22.135645 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051c003-739a-455c-bfd5-af5e883b6a8d None admin] PATH_INFO: `/v3/projects/754d04e2573f4c81b21775be5d8d103e` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:22.137005 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7051c003-739a-455c-bfd5-af5e883b6a8d None admin] RBAC: Authorizing `identity:get_project(project_id=754d04e2573f4c81b21775be5d8d103e)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:22.139526 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7051c003-739a-455c-bfd5-af5e883b6a8d None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:22.141510 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 88/176] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Oct 1 20:32:21 2022] GET /identity/v3/projects/754d04e2573f4c81b21775be5d8d103e => generated 298 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 20:32:22.143077 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd7a49-4ed6-478a-9457-7a03f4e891d2 None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:22.143463 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd7a49-4ed6-478a-9457-7a03f4e891d2 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:22.143855 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd7a49-4ed6-478a-9457-7a03f4e891d2 None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:22.145485 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 89/177] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:32:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:32:22.146709 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13606b2-623a-453a-8452-da005ad0b7c8 None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:22.147088 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13606b2-623a-453a-8452-da005ad0b7c8 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:22.147457 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13606b2-623a-453a-8452-da005ad0b7c8 None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:22.152546 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 90/178] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:32:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:32:22.152546 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13606b2-623a-453a-8452-da005ad0b7c8 None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:22.199053 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:22.209100 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 89/179] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Oct 1 20:32:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 01 20:32:22.210531 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c1a95-8652-4c55-8724-f4337cbd2574 None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:22.215255 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c1a95-8652-4c55-8724-f4337cbd2574 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:22.215255 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c1a95-8652-4c55-8724-f4337cbd2574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:22.233883 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-018c1a95-8652-4c55-8724-f4337cbd2574 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:32:22.235501 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-018c1a95-8652-4c55-8724-f4337cbd2574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:32:22.286175 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13606b2-623a-453a-8452-da005ad0b7c8 None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:22.322385 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 90/180] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:32:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 20:32:22.328553 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a62fc-1f00-4e6e-a53a-345a9a7264ad None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:22.328553 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a62fc-1f00-4e6e-a53a-345a9a7264ad None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:22.328553 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a62fc-1f00-4e6e-a53a-345a9a7264ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:22.328793 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac672730-b8eb-4ee9-83fc-4bdcb9fe6c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:22.328793 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac672730-b8eb-4ee9-83fc-4bdcb9fe6c6f None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:22.330064 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac672730-b8eb-4ee9-83fc-4bdcb9fe6c6f None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:22.330064 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac672730-b8eb-4ee9-83fc-4bdcb9fe6c6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:22.331987 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac672730-b8eb-4ee9-83fc-4bdcb9fe6c6f None admin] RBAC: Adding query filter params (role.id=8789e127ff4549b4883a92a87573ad3e, scope.project.id=754d04e2573f4c81b21775be5d8d103e, user.id=b209a483d1084566a09bb6c4ec92134f) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:32:22.331987 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac672730-b8eb-4ee9-83fc-4bdcb9fe6c6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:22.332473 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac672730-b8eb-4ee9-83fc-4bdcb9fe6c6f None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:22.339085 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 91/181] 10.222.0.23 () {56 vars in 1374 bytes} [Sat Oct 1 20:32:22 2022] GET /identity/v3/role_assignments?user.id=b209a483d1084566a09bb6c4ec92134f&scope.project.id=754d04e2573f4c81b21775be5d8d103e&role.id=8789e127ff4549b4883a92a87573ad3e => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:22.339903 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac672730-b8eb-4ee9-83fc-4bdcb9fe6c6f None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:22.353677 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-678a62fc-1f00-4e6e-a53a-345a9a7264ad None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:32:22.354881 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-678a62fc-1f00-4e6e-a53a-345a9a7264ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:32:22.387438 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:22.515851 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 91/182] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:32:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 20:32:22.526493 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:22.528747 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5bfbf3-9636-485d-986d-f3e27ef1cc63 None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:22.530159 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5bfbf3-9636-485d-986d-f3e27ef1cc63 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:22.530795 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5bfbf3-9636-485d-986d-f3e27ef1cc63 None None] PATH_INFO: `/` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:22.533767 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac672730-b8eb-4ee9-83fc-4bdcb9fe6c6f None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:22.536627 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 92/183] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:32:22 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:32:22.543782 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508bad00-0ad8-4c06-a796-7bf51af3cfd8 None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:22.549686 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508bad00-0ad8-4c06-a796-7bf51af3cfd8 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:22.550279 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508bad00-0ad8-4c06-a796-7bf51af3cfd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:22.593650 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-508bad00-0ad8-4c06-a796-7bf51af3cfd8 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:32:22.594871 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-508bad00-0ad8-4c06-a796-7bf51af3cfd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:32:22.631569 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ba8ef9-b217-45c1-b635-fda0f3d2fc11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:22.632212 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ba8ef9-b217-45c1-b635-fda0f3d2fc11 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:22.632490 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ba8ef9-b217-45c1-b635-fda0f3d2fc11 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:22.632796 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ba8ef9-b217-45c1-b635-fda0f3d2fc11 None admin] PATH_INFO: `/v3/projects/0f5d7a8894224723b2e587bed1efaf3f` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:22.634903 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ba8ef9-b217-45c1-b635-fda0f3d2fc11 None admin] RBAC: Authorizing `identity:get_project(project_id=0f5d7a8894224723b2e587bed1efaf3f)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:22.636358 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ba8ef9-b217-45c1-b635-fda0f3d2fc11 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:22.638030 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 92/184] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Oct 1 20:32:22 2022] GET /identity/v3/projects/0f5d7a8894224723b2e587bed1efaf3f => generated 312 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:22.645546 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ba8ef9-b217-45c1-b635-fda0f3d2fc11 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:22.694759 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 93/185] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:32:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 20:32:22.729808 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508bad00-0ad8-4c06-a796-7bf51af3cfd8 None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:22.854193 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ba8ef9-b217-45c1-b635-fda0f3d2fc11 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:22.860891 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:22.902227 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508bad00-0ad8-4c06-a796-7bf51af3cfd8 None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:22.921002 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d250dc2-e2f6-4881-8e9c-f9a74bd0da41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:22.921613 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d250dc2-e2f6-4881-8e9c-f9a74bd0da41 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:22.921891 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d250dc2-e2f6-4881-8e9c-f9a74bd0da41 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:22.922241 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d250dc2-e2f6-4881-8e9c-f9a74bd0da41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:22.923591 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d250dc2-e2f6-4881-8e9c-f9a74bd0da41 None admin] RBAC: Adding query filter params (role.id=82138515a02147ccb30f8d56863aab87, scope.project.id=0f5d7a8894224723b2e587bed1efaf3f, user.id=b209a483d1084566a09bb6c4ec92134f) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:32:22.923899 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d250dc2-e2f6-4881-8e9c-f9a74bd0da41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:22.925377 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d250dc2-e2f6-4881-8e9c-f9a74bd0da41 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:22.940772 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 93/186] 10.222.0.23 () {56 vars in 1374 bytes} [Sat Oct 1 20:32:22 2022] GET /identity/v3/role_assignments?user.id=b209a483d1084566a09bb6c4ec92134f&scope.project.id=0f5d7a8894224723b2e587bed1efaf3f&role.id=82138515a02147ccb30f8d56863aab87 => generated 608 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:22.964990 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331d4241-afd0-43c0-9d62-a2e9f9d5d05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:22.965671 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d4241-afd0-43c0-9d62-a2e9f9d5d05d None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:22.965921 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d4241-afd0-43c0-9d62-a2e9f9d5d05d None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:22.966193 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d4241-afd0-43c0-9d62-a2e9f9d5d05d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:22.979240 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331d4241-afd0-43c0-9d62-a2e9f9d5d05d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 20:32:22.984287 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application [None req-331d4241-afd0-43c0-9d62-a2e9f9d5d05d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 20:32:22.984287 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:32:22.984287 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:32:22.984287 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:32:22.984287 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:32:22.984287 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:32:22.984287 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:32:22.984287 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:32:22.984287 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:32:22.984287 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:32:22.984287 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:32:22.984287 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:32:22.984287 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 20:32:22.984287 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 20:32:22.984287 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 20:32:22.984287 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 20:32:22.985644 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 20:32:22.985644 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 20:32:22.985644 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 20:32:22.985644 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 20:32:22.985644 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:32:22.985644 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:32:22.985644 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:32:22.985644 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:32:22.985644 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:32:22.985644 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:32:22.985644 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:32:22.985644 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application with Lock( Oct 01 20:32:22.985644 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:32:22.985644 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:32:22.985644 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:32:22.985644 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:32:22.986423 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:32:22.986423 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:32:22.986423 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:32:22.986423 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:32:22.986423 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 20:32:22.986423 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 20:32:22.986423 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 20:32:22.986423 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 20:32:22.986423 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 20:32:22.986423 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 20:32:22.986423 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 20:32:22.986423 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:32:22.986423 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 94/187] 10.222.0.23 () {56 vars in 1096 bytes} [Sat Oct 1 20:32:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 01 20:32:22.991469 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039f3040-4acc-4f92-a3fd-b8f2d9a29b0d None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:22.991753 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039f3040-4acc-4f92-a3fd-b8f2d9a29b0d None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:22.992034 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039f3040-4acc-4f92-a3fd-b8f2d9a29b0d None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:22.993533 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 94/188] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:32:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:32:22.995434 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331d4241-afd0-43c0-9d62-a2e9f9d5d05d None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:23.005500 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18149a08-31f1-47e1-9668-edf0f140b6bb None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:23.005802 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18149a08-31f1-47e1-9668-edf0f140b6bb None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:23.006027 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18149a08-31f1-47e1-9668-edf0f140b6bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:23.038578 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-18149a08-31f1-47e1-9668-edf0f140b6bb None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:32:23.040140 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-18149a08-31f1-47e1-9668-edf0f140b6bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:32:23.079534 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:23.135477 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 95/189] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:32:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 20:32:23.136084 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331d4241-afd0-43c0-9d62-a2e9f9d5d05d None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:23.145550 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18149a08-31f1-47e1-9668-edf0f140b6bb None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:23.194020 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5a9638-9331-475b-b2d2-5b704a42ea5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:23.194891 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a9638-9331-475b-b2d2-5b704a42ea5c None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:23.195169 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a9638-9331-475b-b2d2-5b704a42ea5c None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:23.195689 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a9638-9331-475b-b2d2-5b704a42ea5c None admin] PATH_INFO: `/v3/roles` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:23.196361 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5a9638-9331-475b-b2d2-5b704a42ea5c None admin] RBAC: Adding query filter params (name=admin) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:32:23.196702 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5a9638-9331-475b-b2d2-5b704a42ea5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:23.199055 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5a9638-9331-475b-b2d2-5b704a42ea5c None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:23.209175 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:23.213565 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 95/190] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Oct 1 20:32:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:23.214490 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5a9638-9331-475b-b2d2-5b704a42ea5c None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:23.289476 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18149a08-31f1-47e1-9668-edf0f140b6bb None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:23.327425 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5a9638-9331-475b-b2d2-5b704a42ea5c None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:23.331453 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9994f0e7-c979-4457-a1a8-4f0c0b71d061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:23.332086 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9994f0e7-c979-4457-a1a8-4f0c0b71d061 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:23.332362 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9994f0e7-c979-4457-a1a8-4f0c0b71d061 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:23.332693 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9994f0e7-c979-4457-a1a8-4f0c0b71d061 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:23.343750 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9994f0e7-c979-4457-a1a8-4f0c0b71d061 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 20:32:23.350596 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-9994f0e7-c979-4457-a1a8-4f0c0b71d061 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 01 20:32:23.350596 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:32:23.350596 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:32:23.350596 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:32:23.350596 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:32:23.350596 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:32:23.350596 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:32:23.350596 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:32:23.350596 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:32:23.350596 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:32:23.350596 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:32:23.350596 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:32:23.350596 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 20:32:23.350596 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 20:32:23.350596 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 20:32:23.350596 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 20:32:23.351511 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 20:32:23.351511 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 20:32:23.351511 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 20:32:23.351511 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 20:32:23.351511 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:32:23.351511 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:32:23.351511 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:32:23.351511 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:32:23.351511 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:32:23.351511 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:32:23.351511 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:32:23.351511 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:32:23.351511 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:32:23.351511 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:32:23.351511 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:32:23.351511 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:32:23.358680 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:32:23.358680 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:32:23.358680 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:32:23.358680 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:32:23.358680 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 20:32:23.358680 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 20:32:23.358680 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 20:32:23.358680 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 20:32:23.358680 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 20:32:23.358680 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 20:32:23.358680 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 01 20:32:23.358680 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:32:23.358680 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 96/191] 10.222.0.23 () {56 vars in 1114 bytes} [Sat Oct 1 20:32:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:32:23.358680 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9994f0e7-c979-4457-a1a8-4f0c0b71d061 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:23.374453 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18eb1c0-1d34-4842-a5a0-c1e53ce9bfa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:23.375691 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18eb1c0-1d34-4842-a5a0-c1e53ce9bfa2 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:23.376261 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18eb1c0-1d34-4842-a5a0-c1e53ce9bfa2 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:23.376637 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18eb1c0-1d34-4842-a5a0-c1e53ce9bfa2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:23.377830 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18eb1c0-1d34-4842-a5a0-c1e53ce9bfa2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:23.379486 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18eb1c0-1d34-4842-a5a0-c1e53ce9bfa2 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:23.381327 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 96/192] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Oct 1 20:32:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:23.384542 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:23.386509 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18eb1c0-1d34-4842-a5a0-c1e53ce9bfa2 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:23.457683 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:23.466823 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9994f0e7-c979-4457-a1a8-4f0c0b71d061 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:23.494379 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18eb1c0-1d34-4842-a5a0-c1e53ce9bfa2 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:23.503159 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f2780c-faf7-470e-b97b-7b24f014504c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:23.503782 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f2780c-faf7-470e-b97b-7b24f014504c None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:23.504054 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f2780c-faf7-470e-b97b-7b24f014504c None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:23.504321 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f2780c-faf7-470e-b97b-7b24f014504c None admin] PATH_INFO: `/v3/users/7dcfe7da41174f79ae76106ebdaa12bf` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:23.517709 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f2780c-faf7-470e-b97b-7b24f014504c None admin] RBAC: Authorizing `identity:get_user(user_id=7dcfe7da41174f79ae76106ebdaa12bf)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:23.519464 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f2780c-faf7-470e-b97b-7b24f014504c None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:23.521087 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 97/193] 10.222.0.23 () {56 vars in 1177 bytes} [Sat Oct 1 20:32:23 2022] GET /identity/v3/users/7dcfe7da41174f79ae76106ebdaa12bf => generated 283 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:23.521819 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f2780c-faf7-470e-b97b-7b24f014504c None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:23.531361 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2327b10-840f-4085-9ad6-7ac968384fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:23.532571 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2327b10-840f-4085-9ad6-7ac968384fe3 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:23.532841 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2327b10-840f-4085-9ad6-7ac968384fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:23.533107 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2327b10-840f-4085-9ad6-7ac968384fe3 None admin] PATH_INFO: `/v3/roles` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:23.533757 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2327b10-840f-4085-9ad6-7ac968384fe3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:32:23.534055 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2327b10-840f-4085-9ad6-7ac968384fe3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:23.535409 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2327b10-840f-4085-9ad6-7ac968384fe3 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:23.543200 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 97/194] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Oct 1 20:32:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:23.544025 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2327b10-840f-4085-9ad6-7ac968384fe3 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:23.603009 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:23.623641 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f2780c-faf7-470e-b97b-7b24f014504c None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:23.643890 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2327b10-840f-4085-9ad6-7ac968384fe3 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:23.659203 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1331767-9da1-4a10-85ca-3358b64e5e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:23.659815 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1331767-9da1-4a10-85ca-3358b64e5e68 None admin] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:23.660089 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1331767-9da1-4a10-85ca-3358b64e5e68 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:23.660355 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1331767-9da1-4a10-85ca-3358b64e5e68 None admin] PATH_INFO: `/v3/users` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:23.661030 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1331767-9da1-4a10-85ca-3358b64e5e68 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:23.663227 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1331767-9da1-4a10-85ca-3358b64e5e68 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:23.675015 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:23.683562 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90faf4ee-0cee-4ffb-b4dc-a809cab65e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:23.684248 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90faf4ee-0cee-4ffb-b4dc-a809cab65e1d None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:23.684549 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90faf4ee-0cee-4ffb-b4dc-a809cab65e1d None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:23.684827 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90faf4ee-0cee-4ffb-b4dc-a809cab65e1d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:23.690323 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 98/195] 10.222.0.23 () {60 vars in 1132 bytes} [Sat Oct 1 20:32:23 2022] POST /identity/v3/users => generated 297 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 20:32:23.691177 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1331767-9da1-4a10-85ca-3358b64e5e68 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:23.699639 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90faf4ee-0cee-4ffb-b4dc-a809cab65e1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 20:32:23.706789 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application [None req-90faf4ee-0cee-4ffb-b4dc-a809cab65e1d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 01 20:32:23.706789 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:32:23.706789 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:32:23.706789 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:32:23.706789 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:32:23.706789 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:32:23.706789 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:32:23.706789 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:32:23.706789 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:32:23.706789 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:32:23.706789 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:32:23.706789 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:32:23.706789 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 20:32:23.706789 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 20:32:23.706789 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 20:32:23.706789 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 20:32:23.707929 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 20:32:23.707929 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 20:32:23.707929 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 20:32:23.707929 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 20:32:23.707929 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:32:23.707929 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:32:23.707929 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:32:23.707929 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:32:23.707929 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:32:23.707929 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:32:23.707929 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:32:23.707929 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application with Lock( Oct 01 20:32:23.707929 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:32:23.707929 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:32:23.707929 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:32:23.707929 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:32:23.709287 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:32:23.709287 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:32:23.709287 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:32:23.709287 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:32:23.709287 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 20:32:23.709287 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 20:32:23.709287 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 20:32:23.709287 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 20:32:23.709287 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 20:32:23.709287 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 20:32:23.709287 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 01 20:32:23.709287 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:32:23.709287 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 98/196] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Oct 1 20:32:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:32:23.712967 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90faf4ee-0cee-4ffb-b4dc-a809cab65e1d None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:23.817442 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1331767-9da1-4a10-85ca-3358b64e5e68 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:23.828708 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90faf4ee-0cee-4ffb-b4dc-a809cab65e1d None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:23.858003 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ce728e-a9ba-4dbe-a38b-caa9000b1038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:23.858636 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce728e-a9ba-4dbe-a38b-caa9000b1038 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:23.858916 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce728e-a9ba-4dbe-a38b-caa9000b1038 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:23.859193 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce728e-a9ba-4dbe-a38b-caa9000b1038 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:23.864031 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:23.866316 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8522df-7e82-4e7a-894d-63c76e341d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:23.866965 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8522df-7e82-4e7a-894d-63c76e341d27 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:23.867271 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8522df-7e82-4e7a-894d-63c76e341d27 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:23.867540 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8522df-7e82-4e7a-894d-63c76e341d27 None admin] PATH_INFO: `/v3/users/7dcfe7da41174f79ae76106ebdaa12bf` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:23.868822 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8522df-7e82-4e7a-894d-63c76e341d27 None admin] RBAC: Authorizing `identity:get_user(user_id=7dcfe7da41174f79ae76106ebdaa12bf)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:23.870894 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8522df-7e82-4e7a-894d-63c76e341d27 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:23.873192 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 99/197] 10.222.0.23 () {56 vars in 1177 bytes} [Sat Oct 1 20:32:23 2022] GET /identity/v3/users/7dcfe7da41174f79ae76106ebdaa12bf => generated 283 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:23.877445 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8522df-7e82-4e7a-894d-63c76e341d27 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:23.944917 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:23.945080 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ce728e-a9ba-4dbe-a38b-caa9000b1038 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:23.946681 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ce728e-a9ba-4dbe-a38b-caa9000b1038 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:24.001709 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8522df-7e82-4e7a-894d-63c76e341d27 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:24.050582 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424a9883-98c1-4470-9260-5f7fc415009c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:24.051577 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a9883-98c1-4470-9260-5f7fc415009c None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:24.052072 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a9883-98c1-4470-9260-5f7fc415009c None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:24.052622 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a9883-98c1-4470-9260-5f7fc415009c None admin] PATH_INFO: `/v3/roles` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:24.053498 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424a9883-98c1-4470-9260-5f7fc415009c None admin] RBAC: Adding query filter params (name=reader) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:32:24.053872 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424a9883-98c1-4470-9260-5f7fc415009c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:24.055431 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424a9883-98c1-4470-9260-5f7fc415009c None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:24.064814 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 100/198] 10.222.0.23 () {56 vars in 1101 bytes} [Sat Oct 1 20:32:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:24.065584 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424a9883-98c1-4470-9260-5f7fc415009c None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:24.089984 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 99/199] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Oct 1 20:32:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 01 20:32:24.090842 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ce728e-a9ba-4dbe-a38b-caa9000b1038 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:24.137573 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:24.191230 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424a9883-98c1-4470-9260-5f7fc415009c None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:24.214729 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:24.231301 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ce728e-a9ba-4dbe-a38b-caa9000b1038 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:24.232375 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33412bcf-f964-4f9e-a874-b9af5f4eca02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:24.233191 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33412bcf-f964-4f9e-a874-b9af5f4eca02 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:24.233639 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33412bcf-f964-4f9e-a874-b9af5f4eca02 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:24.233979 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33412bcf-f964-4f9e-a874-b9af5f4eca02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:24.273720 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b006207e-a38f-4dbd-a72c-350b973a5bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:24.274351 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006207e-a38f-4dbd-a72c-350b973a5bbd None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:24.274621 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006207e-a38f-4dbd-a72c-350b973a5bbd None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:24.274886 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006207e-a38f-4dbd-a72c-350b973a5bbd None admin] PATH_INFO: `/v3/users/2bb3ed388eb64483a07605d22e91f089` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:24.276025 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b006207e-a38f-4dbd-a72c-350b973a5bbd None admin] RBAC: Authorizing `identity:get_user(user_id=2bb3ed388eb64483a07605d22e91f089)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:24.277924 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b006207e-a38f-4dbd-a72c-350b973a5bbd None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:24.279511 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 100/200] 10.222.0.23 () {56 vars in 1177 bytes} [Sat Oct 1 20:32:24 2022] GET /identity/v3/users/2bb3ed388eb64483a07605d22e91f089 => generated 289 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:24.280738 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b006207e-a38f-4dbd-a72c-350b973a5bbd None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:24.310130 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33412bcf-f964-4f9e-a874-b9af5f4eca02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:24.311725 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33412bcf-f964-4f9e-a874-b9af5f4eca02 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:24.462147 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b006207e-a38f-4dbd-a72c-350b973a5bbd None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:24.476949 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:24.528560 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 101/201] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Oct 1 20:32:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 01 20:32:24.530205 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33412bcf-f964-4f9e-a874-b9af5f4eca02 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:24.555445 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33844ae7-5447-4e76-9f0f-d3dcf8d359ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:24.556084 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33844ae7-5447-4e76-9f0f-d3dcf8d359ce None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:24.556364 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33844ae7-5447-4e76-9f0f-d3dcf8d359ce None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:24.557246 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33844ae7-5447-4e76-9f0f-d3dcf8d359ce None admin] PATH_INFO: `/v3/projects/4357ac4f8a434b11a19fefd8982470d2` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:24.559078 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33844ae7-5447-4e76-9f0f-d3dcf8d359ce None admin] RBAC: Authorizing `identity:get_project(project_id=4357ac4f8a434b11a19fefd8982470d2)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:24.560560 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33844ae7-5447-4e76-9f0f-d3dcf8d359ce None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:24.562194 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 101/202] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Oct 1 20:32:24 2022] GET /identity/v3/projects/4357ac4f8a434b11a19fefd8982470d2 => generated 302 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:24.563480 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33844ae7-5447-4e76-9f0f-d3dcf8d359ce None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:24.592906 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:24.685062 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33412bcf-f964-4f9e-a874-b9af5f4eca02 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:24.763531 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f260a-0637-4dae-8ada-ec79416ce3b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:24.763531 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f260a-0637-4dae-8ada-ec79416ce3b1 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:24.763531 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f260a-0637-4dae-8ada-ec79416ce3b1 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:24.763531 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f260a-0637-4dae-8ada-ec79416ce3b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:24.796556 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33844ae7-5447-4e76-9f0f-d3dcf8d359ce None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:24.845287 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae5a0ef-c1f8-494c-b71c-51e8d04c7662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:24.845919 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae5a0ef-c1f8-494c-b71c-51e8d04c7662 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:24.846197 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae5a0ef-c1f8-494c-b71c-51e8d04c7662 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:24.846567 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae5a0ef-c1f8-494c-b71c-51e8d04c7662 None admin] PATH_INFO: `/v3/projects/4357ac4f8a434b11a19fefd8982470d2` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:24.847740 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae5a0ef-c1f8-494c-b71c-51e8d04c7662 None admin] RBAC: Authorizing `identity:get_project(project_id=4357ac4f8a434b11a19fefd8982470d2)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:24.849476 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae5a0ef-c1f8-494c-b71c-51e8d04c7662 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:24.851797 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 102/203] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Oct 1 20:32:24 2022] GET /identity/v3/projects/4357ac4f8a434b11a19fefd8982470d2 => generated 302 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:24.857794 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae5a0ef-c1f8-494c-b71c-51e8d04c7662 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:24.865526 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36f260a-0637-4dae-8ada-ec79416ce3b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:24.867029 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36f260a-0637-4dae-8ada-ec79416ce3b1 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:24.893014 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:24.912626 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:24.979782 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae5a0ef-c1f8-494c-b71c-51e8d04c7662 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:24.981034 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 102/204] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Oct 1 20:32:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 01 20:32:24.981722 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f260a-0637-4dae-8ada-ec79416ce3b1 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:25.021158 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0b05c0-487f-4693-94ae-49f70b6cbe49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:25.022065 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0b05c0-487f-4693-94ae-49f70b6cbe49 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:25.022514 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0b05c0-487f-4693-94ae-49f70b6cbe49 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:25.022954 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0b05c0-487f-4693-94ae-49f70b6cbe49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:25.023845 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0b05c0-487f-4693-94ae-49f70b6cbe49 None admin] RBAC: Adding query filter params (role.id=d11e7ba2f1fa41ff8ea8dda2a8d1466f, scope.project.id=4357ac4f8a434b11a19fefd8982470d2, user.id=7dcfe7da41174f79ae76106ebdaa12bf) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:32:25.024321 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0b05c0-487f-4693-94ae-49f70b6cbe49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:25.025965 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0b05c0-487f-4693-94ae-49f70b6cbe49 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:25.032790 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 103/205] 10.222.0.23 () {56 vars in 1374 bytes} [Sat Oct 1 20:32:24 2022] GET /identity/v3/role_assignments?user.id=7dcfe7da41174f79ae76106ebdaa12bf&scope.project.id=4357ac4f8a434b11a19fefd8982470d2&role.id=d11e7ba2f1fa41ff8ea8dda2a8d1466f => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:25.033840 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0b05c0-487f-4693-94ae-49f70b6cbe49 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:25.101371 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f260a-0637-4dae-8ada-ec79416ce3b1 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:25.124779 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:25.142669 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffac2beb-523b-48ab-80a4-73f5ff47b968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:25.143340 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac2beb-523b-48ab-80a4-73f5ff47b968 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:25.143626 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac2beb-523b-48ab-80a4-73f5ff47b968 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:25.143888 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac2beb-523b-48ab-80a4-73f5ff47b968 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:25.144647 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffac2beb-523b-48ab-80a4-73f5ff47b968 None admin] RBAC: Adding query filter params (role.id=8789e127ff4549b4883a92a87573ad3e, scope.project.id=4357ac4f8a434b11a19fefd8982470d2, user.id=7dcfe7da41174f79ae76106ebdaa12bf) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:32:25.144954 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffac2beb-523b-48ab-80a4-73f5ff47b968 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:25.146414 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffac2beb-523b-48ab-80a4-73f5ff47b968 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:25.152761 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 103/206] 10.222.0.23 () {56 vars in 1374 bytes} [Sat Oct 1 20:32:24 2022] GET /identity/v3/role_assignments?user.id=7dcfe7da41174f79ae76106ebdaa12bf&scope.project.id=4357ac4f8a434b11a19fefd8982470d2&role.id=8789e127ff4549b4883a92a87573ad3e => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:25.166846 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0b05c0-487f-4693-94ae-49f70b6cbe49 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:25.173681 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:25.220874 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d641a07-9355-47ef-b737-101f3be93dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:25.221858 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d641a07-9355-47ef-b737-101f3be93dc9 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:25.222311 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d641a07-9355-47ef-b737-101f3be93dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:25.222758 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d641a07-9355-47ef-b737-101f3be93dc9 None admin] PATH_INFO: `/v3/projects/754d04e2573f4c81b21775be5d8d103e` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:25.229544 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d641a07-9355-47ef-b737-101f3be93dc9 None admin] RBAC: Authorizing `identity:get_project(project_id=754d04e2573f4c81b21775be5d8d103e)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:25.231451 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d641a07-9355-47ef-b737-101f3be93dc9 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:25.233513 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 104/207] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Oct 1 20:32:25 2022] GET /identity/v3/projects/754d04e2573f4c81b21775be5d8d103e => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:25.240215 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffac2beb-523b-48ab-80a4-73f5ff47b968 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:25.400472 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffac2beb-523b-48ab-80a4-73f5ff47b968 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:25.450800 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17c1e52-1029-42b7-b644-584e12dd33ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:25.451812 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c1e52-1029-42b7-b644-584e12dd33ec None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:25.452298 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c1e52-1029-42b7-b644-584e12dd33ec None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:25.452818 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c1e52-1029-42b7-b644-584e12dd33ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:25.453979 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17c1e52-1029-42b7-b644-584e12dd33ec None admin] RBAC: Adding query filter params (role.id=593409d904954a0f8039eda5aa05fc40, scope.project.id=754d04e2573f4c81b21775be5d8d103e, user.id=2bb3ed388eb64483a07605d22e91f089) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:32:25.454668 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17c1e52-1029-42b7-b644-584e12dd33ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:25.456323 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17c1e52-1029-42b7-b644-584e12dd33ec None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:25.467270 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 104/208] 10.222.0.23 () {56 vars in 1374 bytes} [Sat Oct 1 20:32:25 2022] GET /identity/v3/role_assignments?user.id=2bb3ed388eb64483a07605d22e91f089&scope.project.id=754d04e2573f4c81b21775be5d8d103e&role.id=593409d904954a0f8039eda5aa05fc40 => generated 608 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:26.432209 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93f2491-d7ac-4832-8bbc-9497722f97e4 None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:26.432756 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93f2491-d7ac-4832-8bbc-9497722f97e4 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:26.432756 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93f2491-d7ac-4832-8bbc-9497722f97e4 None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:26.434269 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 105/209] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:32:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:32:26.439643 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9c0e5b-c9d6-4ec0-bd12-51b091a475d9 None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:26.440058 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9c0e5b-c9d6-4ec0-bd12-51b091a475d9 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:26.440228 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9c0e5b-c9d6-4ec0-bd12-51b091a475d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:26.465117 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-ca9c0e5b-c9d6-4ec0-bd12-51b091a475d9 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:32:26.466320 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-ca9c0e5b-c9d6-4ec0-bd12-51b091a475d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:32:26.515897 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:26.539771 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 105/210] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:32:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 01 20:32:26.585387 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d699ce-f49a-4f0b-bfa1-d6658019385d None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:26.586025 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d699ce-f49a-4f0b-bfa1-d6658019385d None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:26.586499 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d699ce-f49a-4f0b-bfa1-d6658019385d None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:26.588188 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 106/211] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:32:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:32:26.602366 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25645cdb-abb5-4ae1-9500-af7008e31fcf None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:26.602934 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25645cdb-abb5-4ae1-9500-af7008e31fcf None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:26.603425 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25645cdb-abb5-4ae1-9500-af7008e31fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:26.622298 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-25645cdb-abb5-4ae1-9500-af7008e31fcf None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:32:26.623784 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-25645cdb-abb5-4ae1-9500-af7008e31fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:32:26.698498 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 106/212] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:32:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 20:32:26.879410 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d699ce-f49a-4f0b-bfa1-d6658019385d None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:26.985655 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d699ce-f49a-4f0b-bfa1-d6658019385d None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:27.019115 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59446cc8-9c5f-49ae-843c-906ec78e041c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:27.019742 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59446cc8-9c5f-49ae-843c-906ec78e041c None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:27.020020 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59446cc8-9c5f-49ae-843c-906ec78e041c None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:27.020287 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59446cc8-9c5f-49ae-843c-906ec78e041c None admin] PATH_INFO: `/v3/roles/member` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:27.030221 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59446cc8-9c5f-49ae-843c-906ec78e041c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 20:32:27.036007 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-59446cc8-9c5f-49ae-843c-906ec78e041c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 01 20:32:27.036007 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:32:27.036007 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:32:27.036007 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:32:27.036007 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:32:27.036007 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:32:27.036007 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:32:27.036007 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:32:27.036007 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:32:27.036007 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:32:27.036007 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:32:27.036007 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:32:27.036007 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 20:32:27.036007 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 20:32:27.036007 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 20:32:27.036007 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 20:32:27.036919 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 20:32:27.036919 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 20:32:27.036919 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 20:32:27.036919 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 20:32:27.036919 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:32:27.036919 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:32:27.036919 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:32:27.036919 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:32:27.036919 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:32:27.036919 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:32:27.036919 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:32:27.036919 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:32:27.036919 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:32:27.036919 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:32:27.036919 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:32:27.036919 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:32:27.037719 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:32:27.037719 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:32:27.037719 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:32:27.037719 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:32:27.037719 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 20:32:27.037719 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 20:32:27.037719 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 20:32:27.037719 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 20:32:27.037719 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 20:32:27.037719 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 20:32:27.037719 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 01 20:32:27.037719 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:32:27.037719 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 107/213] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Oct 1 20:32:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:32:27.042919 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25645cdb-abb5-4ae1-9500-af7008e31fcf None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:27.051942 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59446cc8-9c5f-49ae-843c-906ec78e041c None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:27.089278 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:27.175604 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59446cc8-9c5f-49ae-843c-906ec78e041c None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:27.183967 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25645cdb-abb5-4ae1-9500-af7008e31fcf None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:27.197647 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:27.215988 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a06024-8d40-40a3-bc60-e17b1ea8d9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:27.217009 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a06024-8d40-40a3-bc60-e17b1ea8d9d3 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:27.217430 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a06024-8d40-40a3-bc60-e17b1ea8d9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:27.217910 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a06024-8d40-40a3-bc60-e17b1ea8d9d3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:27.219834 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a06024-8d40-40a3-bc60-e17b1ea8d9d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:27.221993 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a06024-8d40-40a3-bc60-e17b1ea8d9d3 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:27.224369 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 108/214] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Oct 1 20:32:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 20:32:27.229390 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a06024-8d40-40a3-bc60-e17b1ea8d9d3 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:27.230313 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595f9e38-36c3-4ad1-88ef-038e6a183114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:27.230918 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f9e38-36c3-4ad1-88ef-038e6a183114 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:27.231193 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f9e38-36c3-4ad1-88ef-038e6a183114 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:27.231455 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f9e38-36c3-4ad1-88ef-038e6a183114 None admin] PATH_INFO: `/v3/roles` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:27.232110 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595f9e38-36c3-4ad1-88ef-038e6a183114 None admin] RBAC: Adding query filter params (name=member) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:32:27.232407 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595f9e38-36c3-4ad1-88ef-038e6a183114 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:27.233796 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595f9e38-36c3-4ad1-88ef-038e6a183114 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:27.249166 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 107/215] 10.222.0.23 () {56 vars in 1101 bytes} [Sat Oct 1 20:32:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:27.251098 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595f9e38-36c3-4ad1-88ef-038e6a183114 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:27.350851 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:27.354490 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a06024-8d40-40a3-bc60-e17b1ea8d9d3 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:27.361909 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595f9e38-36c3-4ad1-88ef-038e6a183114 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:27.391834 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48a858d-067b-42e1-a0c1-13f293fe98bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:27.392821 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a858d-067b-42e1-a0c1-13f293fe98bc None admin] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:27.393237 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a858d-067b-42e1-a0c1-13f293fe98bc None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:27.393642 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a858d-067b-42e1-a0c1-13f293fe98bc None admin] PATH_INFO: `/v3/users` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:27.394440 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48a858d-067b-42e1-a0c1-13f293fe98bc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:27.396094 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48a858d-067b-42e1-a0c1-13f293fe98bc None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:27.399217 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ca5e29-c0a2-42eb-acc7-a7f9c9d7f7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:27.400054 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca5e29-c0a2-42eb-acc7-a7f9c9d7f7b6 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:27.400477 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca5e29-c0a2-42eb-acc7-a7f9c9d7f7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:27.400912 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca5e29-c0a2-42eb-acc7-a7f9c9d7f7b6 None admin] PATH_INFO: `/v3/users/eb58a3d5969d4fc0b0ea5814841e6268` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:27.415451 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ca5e29-c0a2-42eb-acc7-a7f9c9d7f7b6 None admin] RBAC: Authorizing `identity:get_user(user_id=eb58a3d5969d4fc0b0ea5814841e6268)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:27.417304 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ca5e29-c0a2-42eb-acc7-a7f9c9d7f7b6 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:27.419166 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 108/216] 10.222.0.23 () {56 vars in 1177 bytes} [Sat Oct 1 20:32:27 2022] GET /identity/v3/users/eb58a3d5969d4fc0b0ea5814841e6268 => generated 297 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 20:32:27.423977 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 109/217] 10.222.0.23 () {60 vars in 1132 bytes} [Sat Oct 1 20:32:27 2022] POST /identity/v3/users => generated 297 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 20:32:27.425228 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48a858d-067b-42e1-a0c1-13f293fe98bc None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:27.550283 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48a858d-067b-42e1-a0c1-13f293fe98bc None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:27.592919 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bd871f-b4c6-4289-80e5-ed1ebe06f94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:27.594316 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd871f-b4c6-4289-80e5-ed1ebe06f94c None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:27.594735 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd871f-b4c6-4289-80e5-ed1ebe06f94c None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:27.595145 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd871f-b4c6-4289-80e5-ed1ebe06f94c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:27.624126 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:27.675622 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bd871f-b4c6-4289-80e5-ed1ebe06f94c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:27.677528 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bd871f-b4c6-4289-80e5-ed1ebe06f94c None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:27.739580 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2347826-be45-45b6-a100-056eb7654fd4 None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:27.740404 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2347826-be45-45b6-a100-056eb7654fd4 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:27.740868 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2347826-be45-45b6-a100-056eb7654fd4 None None] PATH_INFO: `/` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:27.742369 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 109/218] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:32:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:32:27.748943 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0650fb40-ac17-4bcb-b09d-8659f065bbde None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:27.749583 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0650fb40-ac17-4bcb-b09d-8659f065bbde None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:27.750941 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0650fb40-ac17-4bcb-b09d-8659f065bbde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:27.777699 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-0650fb40-ac17-4bcb-b09d-8659f065bbde None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:32:27.781597 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-0650fb40-ac17-4bcb-b09d-8659f065bbde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:32:27.790193 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 110/219] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Oct 1 20:32:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 01 20:32:27.796550 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bd871f-b4c6-4289-80e5-ed1ebe06f94c None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:27.812682 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:27.865093 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:27.879125 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 110/220] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:32:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 20:32:27.916301 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bd871f-b4c6-4289-80e5-ed1ebe06f94c None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:27.951886 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163ea957-b3bc-4997-b9c2-97486b42b5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:27.952512 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ea957-b3bc-4997-b9c2-97486b42b5ff None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:27.953957 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ea957-b3bc-4997-b9c2-97486b42b5ff None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:27.954237 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ea957-b3bc-4997-b9c2-97486b42b5ff None admin] PATH_INFO: `/v3/projects/4357ac4f8a434b11a19fefd8982470d2` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:27.955390 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163ea957-b3bc-4997-b9c2-97486b42b5ff None admin] RBAC: Authorizing `identity:get_project(project_id=4357ac4f8a434b11a19fefd8982470d2)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:27.956866 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163ea957-b3bc-4997-b9c2-97486b42b5ff None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:27.958601 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 111/221] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Oct 1 20:32:27 2022] GET /identity/v3/projects/4357ac4f8a434b11a19fefd8982470d2 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:27.964462 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0650fb40-ac17-4bcb-b09d-8659f065bbde None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:28.024419 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b26fac6-925a-4f1b-9cbf-ae5ebd344af2 None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:28.024767 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b26fac6-925a-4f1b-9cbf-ae5ebd344af2 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:28.025009 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b26fac6-925a-4f1b-9cbf-ae5ebd344af2 None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:28.027193 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 112/222] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:32:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:32:28.032825 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ff37e-e4a4-46ad-aaf8-09b0b8487a1d None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:28.033219 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ff37e-e4a4-46ad-aaf8-09b0b8487a1d None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:28.033585 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ff37e-e4a4-46ad-aaf8-09b0b8487a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:28.057617 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-a51ff37e-e4a4-46ad-aaf8-09b0b8487a1d None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:32:28.058830 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-a51ff37e-e4a4-46ad-aaf8-09b0b8487a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:32:28.116002 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0650fb40-ac17-4bcb-b09d-8659f065bbde None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:28.171165 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 113/223] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:32:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 20:32:28.180942 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb4bfda-112e-4ff2-9381-7e7d2cc7445e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:28.181573 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb4bfda-112e-4ff2-9381-7e7d2cc7445e None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:28.181852 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb4bfda-112e-4ff2-9381-7e7d2cc7445e None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:28.182126 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb4bfda-112e-4ff2-9381-7e7d2cc7445e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:28.182856 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb4bfda-112e-4ff2-9381-7e7d2cc7445e None admin] RBAC: Adding query filter params (role.id=82138515a02147ccb30f8d56863aab87, scope.project.id=4357ac4f8a434b11a19fefd8982470d2, user.id=eb58a3d5969d4fc0b0ea5814841e6268) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:32:28.183163 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb4bfda-112e-4ff2-9381-7e7d2cc7445e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:28.184640 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb4bfda-112e-4ff2-9381-7e7d2cc7445e None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:28.191042 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 111/224] 10.222.0.23 () {56 vars in 1374 bytes} [Sat Oct 1 20:32:27 2022] GET /identity/v3/role_assignments?user.id=eb58a3d5969d4fc0b0ea5814841e6268&scope.project.id=4357ac4f8a434b11a19fefd8982470d2&role.id=82138515a02147ccb30f8d56863aab87 => generated 259 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:28.248056 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51ff37e-e4a4-46ad-aaf8-09b0b8487a1d None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:28.321939 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:28.377693 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51ff37e-e4a4-46ad-aaf8-09b0b8487a1d None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:28.414969 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ee7220-1121-4b14-8466-8a91575d83bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:28.415618 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee7220-1121-4b14-8466-8a91575d83bd None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:28.415897 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee7220-1121-4b14-8466-8a91575d83bd None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:28.416166 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee7220-1121-4b14-8466-8a91575d83bd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:28.427832 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ee7220-1121-4b14-8466-8a91575d83bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 20:32:28.433008 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-19ee7220-1121-4b14-8466-8a91575d83bd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 20:32:28.433008 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:32:28.433008 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:32:28.433008 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:32:28.433008 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:32:28.433008 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:32:28.433008 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:32:28.433008 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:32:28.433008 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:32:28.433008 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:32:28.433008 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:32:28.433008 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:32:28.433008 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 20:32:28.433008 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 20:32:28.433008 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 20:32:28.433008 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 20:32:28.433930 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 20:32:28.433930 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 20:32:28.433930 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 20:32:28.433930 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 20:32:28.433930 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:32:28.433930 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:32:28.433930 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:32:28.433930 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:32:28.433930 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:32:28.433930 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:32:28.433930 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:32:28.433930 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:32:28.433930 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:32:28.433930 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:32:28.433930 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:32:28.433930 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:32:28.434716 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:32:28.434716 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:32:28.434716 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:32:28.434716 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:32:28.434716 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 20:32:28.434716 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 20:32:28.434716 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 20:32:28.434716 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 20:32:28.434716 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 20:32:28.434716 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 20:32:28.434716 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 20:32:28.434716 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:32:28.434716 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 114/225] 10.222.0.23 () {56 vars in 1096 bytes} [Sat Oct 1 20:32:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:32:28.442187 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb4bfda-112e-4ff2-9381-7e7d2cc7445e None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:28.467875 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:28.545564 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ee7220-1121-4b14-8466-8a91575d83bd None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:28.604632 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb4bfda-112e-4ff2-9381-7e7d2cc7445e None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:28.671473 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660fd0ca-6792-4c56-ac15-e776ab694d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:28.672561 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660fd0ca-6792-4c56-ac15-e776ab694d4d None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:28.672834 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660fd0ca-6792-4c56-ac15-e776ab694d4d None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:28.673292 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660fd0ca-6792-4c56-ac15-e776ab694d4d None admin] PATH_INFO: `/v3/roles` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:28.674132 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660fd0ca-6792-4c56-ac15-e776ab694d4d None admin] RBAC: Adding query filter params (name=admin) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:32:28.674572 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660fd0ca-6792-4c56-ac15-e776ab694d4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:28.676094 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660fd0ca-6792-4c56-ac15-e776ab694d4d None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:28.686337 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 112/226] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Oct 1 20:32:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:28.694426 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660fd0ca-6792-4c56-ac15-e776ab694d4d None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:28.732359 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ee7220-1121-4b14-8466-8a91575d83bd None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:28.763395 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:28.818168 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aa36df-8497-4ae0-a4cb-e06c67b8035e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:28.819066 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa36df-8497-4ae0-a4cb-e06c67b8035e None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:28.819341 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa36df-8497-4ae0-a4cb-e06c67b8035e None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:28.819610 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa36df-8497-4ae0-a4cb-e06c67b8035e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:28.841255 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aa36df-8497-4ae0-a4cb-e06c67b8035e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 20:32:28.846233 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-a5aa36df-8497-4ae0-a4cb-e06c67b8035e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 01 20:32:28.846233 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:32:28.846233 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:32:28.846233 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:32:28.846233 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:32:28.846233 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:32:28.846233 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:32:28.846233 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:32:28.846233 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:32:28.846233 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:32:28.846233 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:32:28.846233 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:32:28.846233 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 20:32:28.846233 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 20:32:28.846233 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 20:32:28.846233 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 20:32:28.847108 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 20:32:28.847108 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 20:32:28.847108 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 20:32:28.847108 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 20:32:28.847108 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:32:28.847108 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:32:28.847108 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:32:28.847108 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:32:28.847108 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:32:28.847108 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:32:28.847108 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:32:28.847108 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:32:28.847108 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:32:28.847108 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:32:28.847108 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:32:28.847108 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:32:28.847925 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:32:28.847925 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:32:28.847925 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:32:28.847925 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:32:28.847925 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 20:32:28.847925 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 20:32:28.847925 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 20:32:28.847925 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 20:32:28.847925 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 20:32:28.847925 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 20:32:28.847925 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 01 20:32:28.847925 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:32:28.847925 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 115/227] 10.222.0.23 () {56 vars in 1114 bytes} [Sat Oct 1 20:32:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:32:28.849171 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:28.855261 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aa36df-8497-4ae0-a4cb-e06c67b8035e None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:28.882632 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660fd0ca-6792-4c56-ac15-e776ab694d4d None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:28.953911 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb511b5-7f15-4270-9bea-ccf185d4dfcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:28.954500 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb511b5-7f15-4270-9bea-ccf185d4dfcd None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:28.954739 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb511b5-7f15-4270-9bea-ccf185d4dfcd None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:28.955022 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb511b5-7f15-4270-9bea-ccf185d4dfcd None admin] PATH_INFO: `/v3/users/7dcfe7da41174f79ae76106ebdaa12bf` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:28.957219 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb511b5-7f15-4270-9bea-ccf185d4dfcd None admin] RBAC: Authorizing `identity:get_user(user_id=7dcfe7da41174f79ae76106ebdaa12bf)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:28.959976 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb511b5-7f15-4270-9bea-ccf185d4dfcd None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:28.962685 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 113/228] 10.222.0.23 () {56 vars in 1177 bytes} [Sat Oct 1 20:32:28 2022] GET /identity/v3/users/7dcfe7da41174f79ae76106ebdaa12bf => generated 283 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 20:32:28.968002 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb511b5-7f15-4270-9bea-ccf185d4dfcd None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:29.024283 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aa36df-8497-4ae0-a4cb-e06c67b8035e None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:29.080172 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8f063c-c088-480a-a273-818ab5a66a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:29.080812 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f063c-c088-480a-a273-818ab5a66a02 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:29.081084 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f063c-c088-480a-a273-818ab5a66a02 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:29.081349 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f063c-c088-480a-a273-818ab5a66a02 None admin] PATH_INFO: `/v3/roles` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:29.082007 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8f063c-c088-480a-a273-818ab5a66a02 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:32:29.082302 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8f063c-c088-480a-a273-818ab5a66a02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:29.083683 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8f063c-c088-480a-a273-818ab5a66a02 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:29.100998 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 116/229] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Oct 1 20:32:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:29.102653 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb511b5-7f15-4270-9bea-ccf185d4dfcd None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:29.109731 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8f063c-c088-480a-a273-818ab5a66a02 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:29.180544 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d3167c-3a48-4c83-8880-3c3a77658a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:29.180544 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d3167c-3a48-4c83-8880-3c3a77658a5e None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:29.180544 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d3167c-3a48-4c83-8880-3c3a77658a5e None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:29.180544 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d3167c-3a48-4c83-8880-3c3a77658a5e None admin] PATH_INFO: `/v3/projects/4357ac4f8a434b11a19fefd8982470d2` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:29.180882 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:29.181408 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d3167c-3a48-4c83-8880-3c3a77658a5e None admin] RBAC: Authorizing `identity:get_project(project_id=4357ac4f8a434b11a19fefd8982470d2)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:29.182883 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d3167c-3a48-4c83-8880-3c3a77658a5e None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:29.184784 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 114/230] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Oct 1 20:32:28 2022] GET /identity/v3/projects/4357ac4f8a434b11a19fefd8982470d2 => generated 302 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:29.191798 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d3167c-3a48-4c83-8880-3c3a77658a5e None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:29.240973 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:29.307387 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8f063c-c088-480a-a273-818ab5a66a02 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:29.364643 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d3167c-3a48-4c83-8880-3c3a77658a5e None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:29.389758 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb601bd-daa9-482e-8061-4696c027fe4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:29.391162 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb601bd-daa9-482e-8061-4696c027fe4a None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:29.391561 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb601bd-daa9-482e-8061-4696c027fe4a None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:29.391927 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb601bd-daa9-482e-8061-4696c027fe4a None admin] PATH_INFO: `/v3/users/7dcfe7da41174f79ae76106ebdaa12bf` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:29.397206 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb601bd-daa9-482e-8061-4696c027fe4a None admin] RBAC: Authorizing `identity:get_user(user_id=7dcfe7da41174f79ae76106ebdaa12bf)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:29.398755 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb601bd-daa9-482e-8061-4696c027fe4a None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:29.400743 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 117/231] 10.222.0.23 () {56 vars in 1177 bytes} [Sat Oct 1 20:32:29 2022] GET /identity/v3/users/7dcfe7da41174f79ae76106ebdaa12bf => generated 283 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:29.401320 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927eba52-0934-4aa5-a99e-fffa1bb60918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:29.407025 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927eba52-0934-4aa5-a99e-fffa1bb60918 None admin] REQUEST_METHOD: `PUT` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:29.407552 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927eba52-0934-4aa5-a99e-fffa1bb60918 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:29.408019 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927eba52-0934-4aa5-a99e-fffa1bb60918 None admin] PATH_INFO: `/v3/projects/4357ac4f8a434b11a19fefd8982470d2/users/7dcfe7da41174f79ae76106ebdaa12bf/roles/d11e7ba2f1fa41ff8ea8dda2a8d1466f` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:29.408274 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb601bd-daa9-482e-8061-4696c027fe4a None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:29.410568 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927eba52-0934-4aa5-a99e-fffa1bb60918 None admin] RBAC: Authorizing `identity:create_grant(project_id=4357ac4f8a434b11a19fefd8982470d2, user_id=7dcfe7da41174f79ae76106ebdaa12bf, role_id=d11e7ba2f1fa41ff8ea8dda2a8d1466f)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:29.412254 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927eba52-0934-4aa5-a99e-fffa1bb60918 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:29.430945 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 115/232] 10.222.0.23 () {58 vars in 1439 bytes} [Sat Oct 1 20:32:29 2022] PUT /identity/v3/projects/4357ac4f8a434b11a19fefd8982470d2/users/7dcfe7da41174f79ae76106ebdaa12bf/roles/d11e7ba2f1fa41ff8ea8dda2a8d1466f => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 20:32:29.540551 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb601bd-daa9-482e-8061-4696c027fe4a None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:29.543702 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:29.581891 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9e8c18-69cd-4419-90d5-da8d6d5145b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:29.582879 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e8c18-69cd-4419-90d5-da8d6d5145b2 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:29.583326 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e8c18-69cd-4419-90d5-da8d6d5145b2 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:29.583797 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e8c18-69cd-4419-90d5-da8d6d5145b2 None admin] PATH_INFO: `/v3/projects/4357ac4f8a434b11a19fefd8982470d2` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:29.585135 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9e8c18-69cd-4419-90d5-da8d6d5145b2 None admin] RBAC: Authorizing `identity:get_project(project_id=4357ac4f8a434b11a19fefd8982470d2)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:29.586800 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9e8c18-69cd-4419-90d5-da8d6d5145b2 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:29.589067 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 118/233] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Oct 1 20:32:29 2022] GET /identity/v3/projects/4357ac4f8a434b11a19fefd8982470d2 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:29.595535 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927eba52-0934-4aa5-a99e-fffa1bb60918 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:29.714875 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:29.743592 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927eba52-0934-4aa5-a99e-fffa1bb60918 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:29.780550 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a34931-a477-436b-9c70-6ea0bce984ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:29.781742 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a34931-a477-436b-9c70-6ea0bce984ff None admin] REQUEST_METHOD: `PUT` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:29.782019 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a34931-a477-436b-9c70-6ea0bce984ff None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:29.782283 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a34931-a477-436b-9c70-6ea0bce984ff None admin] PATH_INFO: `/v3/projects/4357ac4f8a434b11a19fefd8982470d2/users/7dcfe7da41174f79ae76106ebdaa12bf/roles/8789e127ff4549b4883a92a87573ad3e` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:29.784454 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a34931-a477-436b-9c70-6ea0bce984ff None admin] RBAC: Authorizing `identity:create_grant(project_id=4357ac4f8a434b11a19fefd8982470d2, user_id=7dcfe7da41174f79ae76106ebdaa12bf, role_id=8789e127ff4549b4883a92a87573ad3e)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:29.785997 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a34931-a477-436b-9c70-6ea0bce984ff None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:29.802296 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 116/234] 10.222.0.23 () {58 vars in 1439 bytes} [Sat Oct 1 20:32:29 2022] PUT /identity/v3/projects/4357ac4f8a434b11a19fefd8982470d2/users/7dcfe7da41174f79ae76106ebdaa12bf/roles/8789e127ff4549b4883a92a87573ad3e => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 20:32:30.454741 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1de1b7d-8ff1-442b-8b95-d94cb107fa86 None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:30.455246 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1de1b7d-8ff1-442b-8b95-d94cb107fa86 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:30.455319 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1de1b7d-8ff1-442b-8b95-d94cb107fa86 None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:30.456953 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 119/235] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:32:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:32:30.462388 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c0d8a-fb80-41fa-a2de-c94df7ab68bc None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:30.462809 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c0d8a-fb80-41fa-a2de-c94df7ab68bc None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:30.462973 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c0d8a-fb80-41fa-a2de-c94df7ab68bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:30.482113 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-d36c0d8a-fb80-41fa-a2de-c94df7ab68bc None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:32:30.483356 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-d36c0d8a-fb80-41fa-a2de-c94df7ab68bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:32:30.554077 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 117/236] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:32:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 01 20:32:30.816600 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b88772d-7928-4ab9-9383-d07ef412ab23 None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:30.816914 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b88772d-7928-4ab9-9383-d07ef412ab23 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:30.817102 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b88772d-7928-4ab9-9383-d07ef412ab23 None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:30.818675 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 120/237] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:32:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:32:30.824324 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192c00cd-e4e9-422f-bec4-3f0b5199ba26 None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:30.824662 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192c00cd-e4e9-422f-bec4-3f0b5199ba26 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:30.824915 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192c00cd-e4e9-422f-bec4-3f0b5199ba26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:30.857617 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-192c00cd-e4e9-422f-bec4-3f0b5199ba26 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:32:30.858815 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-192c00cd-e4e9-422f-bec4-3f0b5199ba26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:32:30.918602 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b88772d-7928-4ab9-9383-d07ef412ab23 None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:30.957401 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:30.961055 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 118/238] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:32:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 20:32:31.086243 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b88772d-7928-4ab9-9383-d07ef412ab23 None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:31.131125 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c235bc39-c717-46a4-b8f1-530dd5029c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:31.131759 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235bc39-c717-46a4-b8f1-530dd5029c2c None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:31.132039 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235bc39-c717-46a4-b8f1-530dd5029c2c None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:31.132312 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235bc39-c717-46a4-b8f1-530dd5029c2c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:31.148726 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c235bc39-c717-46a4-b8f1-530dd5029c2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 20:32:31.153639 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-c235bc39-c717-46a4-b8f1-530dd5029c2c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 01 20:32:31.153639 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:32:31.153639 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:32:31.153639 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:32:31.153639 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:32:31.153639 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:32:31.153639 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:32:31.153639 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:32:31.153639 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:32:31.153639 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:32:31.153639 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:32:31.153639 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:32:31.153639 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 20:32:31.153639 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 20:32:31.153639 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 20:32:31.153639 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 20:32:31.154539 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 20:32:31.154539 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 20:32:31.154539 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 20:32:31.154539 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 20:32:31.154539 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:32:31.154539 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:32:31.154539 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:32:31.154539 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:32:31.154539 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:32:31.154539 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:32:31.154539 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:32:31.154539 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:32:31.154539 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:32:31.154539 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:32:31.154539 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:32:31.154539 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:32:31.155319 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:32:31.155319 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:32:31.155319 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:32:31.155319 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:32:31.155319 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 20:32:31.155319 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 20:32:31.155319 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 20:32:31.155319 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 20:32:31.155319 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 20:32:31.155319 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 20:32:31.155319 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 01 20:32:31.155319 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:32:31.155319 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 121/239] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Oct 1 20:32:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:32:31.165581 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192c00cd-e4e9-422f-bec4-3f0b5199ba26 None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:31.291068 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c235bc39-c717-46a4-b8f1-530dd5029c2c None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:31.325653 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192c00cd-e4e9-422f-bec4-3f0b5199ba26 None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:31.351961 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:31.368849 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dc9a5c-bd65-45d6-915e-129993e01e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:31.369530 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dc9a5c-bd65-45d6-915e-129993e01e59 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:31.369812 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dc9a5c-bd65-45d6-915e-129993e01e59 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:31.370093 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dc9a5c-bd65-45d6-915e-129993e01e59 None admin] PATH_INFO: `/v3/roles` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:31.371260 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dc9a5c-bd65-45d6-915e-129993e01e59 None admin] RBAC: Adding query filter params (name=reader) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:32:31.371568 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dc9a5c-bd65-45d6-915e-129993e01e59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:31.373003 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dc9a5c-bd65-45d6-915e-129993e01e59 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:31.383646 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 119/240] 10.222.0.23 () {56 vars in 1101 bytes} [Sat Oct 1 20:32:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:31.389225 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dc9a5c-bd65-45d6-915e-129993e01e59 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:31.461764 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c235bc39-c717-46a4-b8f1-530dd5029c2c None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:31.488542 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:31.506989 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227e3efd-37e4-40ef-ab92-dddd36fbde09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:31.507622 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e3efd-37e4-40ef-ab92-dddd36fbde09 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:31.507901 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e3efd-37e4-40ef-ab92-dddd36fbde09 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:31.508170 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e3efd-37e4-40ef-ab92-dddd36fbde09 None admin] PATH_INFO: `/v3/domains/default` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:31.509381 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227e3efd-37e4-40ef-ab92-dddd36fbde09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:31.510830 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227e3efd-37e4-40ef-ab92-dddd36fbde09 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:31.512745 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 122/241] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Oct 1 20:32:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:31.513997 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81bff80-f226-44db-9829-cbd6e527a411 None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:31.514279 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81bff80-f226-44db-9829-cbd6e527a411 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:31.514551 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81bff80-f226-44db-9829-cbd6e527a411 None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:31.516489 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 123/242] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:32:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:32:31.521305 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81bff80-f226-44db-9829-cbd6e527a411 None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:31.537115 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dc9a5c-bd65-45d6-915e-129993e01e59 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:31.582500 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20926f3c-4466-429b-9f90-ae9dfd90254f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:31.583493 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20926f3c-4466-429b-9f90-ae9dfd90254f None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:31.583779 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20926f3c-4466-429b-9f90-ae9dfd90254f None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:31.584052 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20926f3c-4466-429b-9f90-ae9dfd90254f None admin] PATH_INFO: `/v3/users/81fdf771f81049ad98e41f1ea383514a` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:31.599186 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20926f3c-4466-429b-9f90-ae9dfd90254f None admin] RBAC: Authorizing `identity:get_user(user_id=81fdf771f81049ad98e41f1ea383514a)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:31.600703 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20926f3c-4466-429b-9f90-ae9dfd90254f None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:31.602558 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 120/243] 10.222.0.23 () {56 vars in 1177 bytes} [Sat Oct 1 20:32:31 2022] GET /identity/v3/users/81fdf771f81049ad98e41f1ea383514a => generated 297 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 20:32:31.603558 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cd71fa-9cda-4c5f-8bbf-3194621dcbcd None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:31.603841 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cd71fa-9cda-4c5f-8bbf-3194621dcbcd None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:31.604187 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cd71fa-9cda-4c5f-8bbf-3194621dcbcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:31.623770 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-55cd71fa-9cda-4c5f-8bbf-3194621dcbcd None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:32:31.625193 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-55cd71fa-9cda-4c5f-8bbf-3194621dcbcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:32:31.647195 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:31.651580 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81bff80-f226-44db-9829-cbd6e527a411 None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:31.692972 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a48e34-c6c0-479a-874e-2ee45d65decb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:31.693881 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a48e34-c6c0-479a-874e-2ee45d65decb None admin] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:31.694191 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a48e34-c6c0-479a-874e-2ee45d65decb None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:31.694685 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a48e34-c6c0-479a-874e-2ee45d65decb None admin] PATH_INFO: `/v3/users` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:31.695732 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a48e34-c6c0-479a-874e-2ee45d65decb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:31.697237 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a48e34-c6c0-479a-874e-2ee45d65decb None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:31.713222 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 121/244] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:32:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 20:32:31.714554 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cd71fa-9cda-4c5f-8bbf-3194621dcbcd None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:31.738041 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 124/245] 10.222.0.23 () {60 vars in 1132 bytes} [Sat Oct 1 20:32:31 2022] POST /identity/v3/users => generated 293 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 20:32:31.784769 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:31.854099 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cd71fa-9cda-4c5f-8bbf-3194621dcbcd None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:31.911004 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2463b42e-4b25-45df-85b2-aa3c9eb57277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:31.911715 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463b42e-4b25-45df-85b2-aa3c9eb57277 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:31.911999 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463b42e-4b25-45df-85b2-aa3c9eb57277 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:31.912270 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463b42e-4b25-45df-85b2-aa3c9eb57277 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:32.019976 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2463b42e-4b25-45df-85b2-aa3c9eb57277 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:32.021556 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2463b42e-4b25-45df-85b2-aa3c9eb57277 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:32.073958 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:32.128958 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 122/246] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Oct 1 20:32:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 01 20:32:32.134623 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a48e34-c6c0-479a-874e-2ee45d65decb None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:32.218353 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2463b42e-4b25-45df-85b2-aa3c9eb57277 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:32.258484 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a48e34-c6c0-479a-874e-2ee45d65decb None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:32.310009 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32956fd-9268-4886-a2dc-fb8adee44fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:32.310672 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32956fd-9268-4886-a2dc-fb8adee44fe0 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:32.310954 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32956fd-9268-4886-a2dc-fb8adee44fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:32.311226 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32956fd-9268-4886-a2dc-fb8adee44fe0 None admin] PATH_INFO: `/v3/projects/4357ac4f8a434b11a19fefd8982470d2` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:32.312541 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32956fd-9268-4886-a2dc-fb8adee44fe0 None admin] RBAC: Authorizing `identity:get_project(project_id=4357ac4f8a434b11a19fefd8982470d2)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:32.314061 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32956fd-9268-4886-a2dc-fb8adee44fe0 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:32.317096 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 125/247] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Oct 1 20:32:32 2022] GET /identity/v3/projects/4357ac4f8a434b11a19fefd8982470d2 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:32.323161 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32956fd-9268-4886-a2dc-fb8adee44fe0 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:32.355163 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:32.377707 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2463b42e-4b25-45df-85b2-aa3c9eb57277 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:32.420176 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba8371f-7f51-4505-8157-18db40659f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:32.421255 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba8371f-7f51-4505-8157-18db40659f86 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:32.422346 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba8371f-7f51-4505-8157-18db40659f86 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:32.422815 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba8371f-7f51-4505-8157-18db40659f86 None admin] PATH_INFO: `/v3/roles/member` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:32.436186 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba8371f-7f51-4505-8157-18db40659f86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 20:32:32.442021 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application [None req-6ba8371f-7f51-4505-8157-18db40659f86 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 01 20:32:32.442021 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:32:32.442021 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:32:32.442021 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:32:32.442021 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:32:32.442021 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:32:32.442021 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:32:32.442021 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:32:32.442021 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:32:32.442021 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:32:32.442021 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:32:32.442021 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:32:32.442021 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 20:32:32.442021 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 20:32:32.442021 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 20:32:32.442021 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 20:32:32.442923 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 20:32:32.442923 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 20:32:32.442923 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 20:32:32.442923 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 20:32:32.442923 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:32:32.442923 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:32:32.442923 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:32:32.442923 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:32:32.442923 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:32:32.442923 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:32:32.442923 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:32:32.442923 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application with Lock( Oct 01 20:32:32.442923 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:32:32.442923 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:32:32.442923 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:32:32.442923 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:32:32.443985 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:32:32.443985 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:32:32.443985 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:32:32.443985 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:32:32.443985 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 20:32:32.443985 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 20:32:32.443985 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 20:32:32.443985 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 20:32:32.443985 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 20:32:32.443985 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 20:32:32.443985 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 01 20:32:32.443985 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:32:32.444641 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32956fd-9268-4886-a2dc-fb8adee44fe0 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:32.447471 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 123/248] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Oct 1 20:32:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 01 20:32:32.451948 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba8371f-7f51-4505-8157-18db40659f86 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:32.469216 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:32.491790 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7799637-e0d5-4f89-81ce-c077bd29bf33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:32.493125 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7799637-e0d5-4f89-81ce-c077bd29bf33 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:32.493632 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7799637-e0d5-4f89-81ce-c077bd29bf33 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:32.494103 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7799637-e0d5-4f89-81ce-c077bd29bf33 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:32.495023 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7799637-e0d5-4f89-81ce-c077bd29bf33 None admin] RBAC: Adding query filter params (role.id=593409d904954a0f8039eda5aa05fc40, scope.project.id=4357ac4f8a434b11a19fefd8982470d2, user.id=81fdf771f81049ad98e41f1ea383514a) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:32:32.495533 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7799637-e0d5-4f89-81ce-c077bd29bf33 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:32.498243 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7799637-e0d5-4f89-81ce-c077bd29bf33 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:32.505893 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 126/249] 10.222.0.23 () {56 vars in 1374 bytes} [Sat Oct 1 20:32:32 2022] GET /identity/v3/role_assignments?user.id=81fdf771f81049ad98e41f1ea383514a&scope.project.id=4357ac4f8a434b11a19fefd8982470d2&role.id=593409d904954a0f8039eda5aa05fc40 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 20:32:32.585820 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba8371f-7f51-4505-8157-18db40659f86 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:32.625757 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3854b699-8dd9-4c2f-9b50-20f453569510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:32.626531 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3854b699-8dd9-4c2f-9b50-20f453569510 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:32.626756 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3854b699-8dd9-4c2f-9b50-20f453569510 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:32.626996 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3854b699-8dd9-4c2f-9b50-20f453569510 None admin] PATH_INFO: `/v3/roles` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:32.627672 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3854b699-8dd9-4c2f-9b50-20f453569510 None admin] RBAC: Adding query filter params (name=member) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:32:32.627971 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3854b699-8dd9-4c2f-9b50-20f453569510 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:32.629425 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3854b699-8dd9-4c2f-9b50-20f453569510 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:32.639156 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 124/250] 10.222.0.23 () {56 vars in 1101 bytes} [Sat Oct 1 20:32:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 20:32:32.644590 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7799637-e0d5-4f89-81ce-c077bd29bf33 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:32.673425 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e849653-6552-448c-86d9-f9f5f1cfccb5 None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:32.673619 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e849653-6552-448c-86d9-f9f5f1cfccb5 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:32.673878 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e849653-6552-448c-86d9-f9f5f1cfccb5 None None] PATH_INFO: `/` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:32.675803 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 125/251] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:32:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 01 20:32:32.681623 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b817c-d860-4417-96ff-ab2d1d05a6d6 None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:32.681800 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b817c-d860-4417-96ff-ab2d1d05a6d6 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:32.681999 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b817c-d860-4417-96ff-ab2d1d05a6d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:32.702005 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-9a2b817c-d860-4417-96ff-ab2d1d05a6d6 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:32:32.703493 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-9a2b817c-d860-4417-96ff-ab2d1d05a6d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:32:32.761051 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:32.774253 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7799637-e0d5-4f89-81ce-c077bd29bf33 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:32.789411 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 126/252] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:32:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 01 20:32:32.820936 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552b8082-8f0a-4742-933b-8b584c6b07ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:32.822303 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552b8082-8f0a-4742-933b-8b584c6b07ce None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:32.823112 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552b8082-8f0a-4742-933b-8b584c6b07ce None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:32.823751 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8811a8c6-1d2a-4890-b433-4c0661e3bdc0 None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:32.824252 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8811a8c6-1d2a-4890-b433-4c0661e3bdc0 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:32.824385 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552b8082-8f0a-4742-933b-8b584c6b07ce None admin] PATH_INFO: `/v3/users/eb58a3d5969d4fc0b0ea5814841e6268` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:32.824464 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8811a8c6-1d2a-4890-b433-4c0661e3bdc0 None None] PATH_INFO: `/` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:32.825755 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552b8082-8f0a-4742-933b-8b584c6b07ce None admin] RBAC: Authorizing `identity:get_user(user_id=eb58a3d5969d4fc0b0ea5814841e6268)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:32.825864 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 127/253] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:32:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 01 20:32:32.827500 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552b8082-8f0a-4742-933b-8b584c6b07ce None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:32.829712 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 127/254] 10.222.0.23 () {56 vars in 1177 bytes} [Sat Oct 1 20:32:32 2022] GET /identity/v3/users/eb58a3d5969d4fc0b0ea5814841e6268 => generated 297 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:32.832375 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc53084-a39d-434e-bfdf-347f5da04582 None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:32.832937 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc53084-a39d-434e-bfdf-347f5da04582 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:32.833412 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc53084-a39d-434e-bfdf-347f5da04582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:32.835074 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552b8082-8f0a-4742-933b-8b584c6b07ce None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:32.840303 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:32.860424 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-5fc53084-a39d-434e-bfdf-347f5da04582 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:32:32.862159 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-5fc53084-a39d-434e-bfdf-347f5da04582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:32:32.948249 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 128/255] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:32:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 20:32:33.001418 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552b8082-8f0a-4742-933b-8b584c6b07ce None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:33.049818 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee7b9d3-6a00-4035-a5d9-9bce53cb05a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:33.050462 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee7b9d3-6a00-4035-a5d9-9bce53cb05a9 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:33.050741 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee7b9d3-6a00-4035-a5d9-9bce53cb05a9 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:33.051018 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee7b9d3-6a00-4035-a5d9-9bce53cb05a9 None admin] PATH_INFO: `/v3/projects/4357ac4f8a434b11a19fefd8982470d2` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:33.052169 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee7b9d3-6a00-4035-a5d9-9bce53cb05a9 None admin] RBAC: Authorizing `identity:get_project(project_id=4357ac4f8a434b11a19fefd8982470d2)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:33.053716 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee7b9d3-6a00-4035-a5d9-9bce53cb05a9 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:33.055426 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 128/256] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Oct 1 20:32:32 2022] GET /identity/v3/projects/4357ac4f8a434b11a19fefd8982470d2 => generated 302 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 20:32:33.061280 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc53084-a39d-434e-bfdf-347f5da04582 None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:33.208018 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc53084-a39d-434e-bfdf-347f5da04582 None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:33.252803 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:33.258265 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbff402-ae3b-4faa-8450-ca9e0f4e8338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:33.258932 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbff402-ae3b-4faa-8450-ca9e0f4e8338 None admin] REQUEST_METHOD: `PUT` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:33.259240 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbff402-ae3b-4faa-8450-ca9e0f4e8338 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:33.259522 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbff402-ae3b-4faa-8450-ca9e0f4e8338 None admin] PATH_INFO: `/v3/projects/4357ac4f8a434b11a19fefd8982470d2/users/eb58a3d5969d4fc0b0ea5814841e6268/roles/82138515a02147ccb30f8d56863aab87` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:33.267207 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbff402-ae3b-4faa-8450-ca9e0f4e8338 None admin] RBAC: Authorizing `identity:create_grant(project_id=4357ac4f8a434b11a19fefd8982470d2, user_id=eb58a3d5969d4fc0b0ea5814841e6268, role_id=82138515a02147ccb30f8d56863aab87)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:33.268724 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbff402-ae3b-4faa-8450-ca9e0f4e8338 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:33.289850 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 129/257] 10.222.0.23 () {58 vars in 1439 bytes} [Sat Oct 1 20:32:33 2022] PUT /identity/v3/projects/4357ac4f8a434b11a19fefd8982470d2/users/eb58a3d5969d4fc0b0ea5814841e6268/roles/82138515a02147ccb30f8d56863aab87 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 20:32:33.301848 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee7b9d3-6a00-4035-a5d9-9bce53cb05a9 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:33.340518 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:33.434522 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee7b9d3-6a00-4035-a5d9-9bce53cb05a9 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:33.453761 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbff402-ae3b-4faa-8450-ca9e0f4e8338 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:33.494361 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5888196b-7bf2-42cc-8ee2-6a26ed3be8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:33.494909 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888196b-7bf2-42cc-8ee2-6a26ed3be8be None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:33.495178 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888196b-7bf2-42cc-8ee2-6a26ed3be8be None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:33.495448 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888196b-7bf2-42cc-8ee2-6a26ed3be8be None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:33.521797 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5888196b-7bf2-42cc-8ee2-6a26ed3be8be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 20:32:33.529510 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-5888196b-7bf2-42cc-8ee2-6a26ed3be8be None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 20:32:33.529510 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:32:33.529510 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:32:33.529510 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:32:33.529510 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:32:33.529510 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:32:33.529510 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:32:33.529510 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:32:33.529510 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:32:33.529510 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:32:33.529510 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:32:33.529510 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:32:33.529510 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 20:32:33.529510 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 20:32:33.529510 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 20:32:33.529510 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 20:32:33.530419 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 20:32:33.530419 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 20:32:33.530419 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 20:32:33.530419 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 20:32:33.530419 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:32:33.530419 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:32:33.530419 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:32:33.530419 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:32:33.530419 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:32:33.530419 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:32:33.530419 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:32:33.530419 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:32:33.530419 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:32:33.530419 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:32:33.530419 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:32:33.530419 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:32:33.531776 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:32:33.531776 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:32:33.531776 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:32:33.531776 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:32:33.531776 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 20:32:33.531776 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 20:32:33.531776 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 20:32:33.531776 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 20:32:33.531776 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 20:32:33.531776 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 20:32:33.531776 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 20:32:33.531776 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:32:33.531776 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 129/258] 10.222.0.23 () {56 vars in 1096 bytes} [Sat Oct 1 20:32:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:32:33.538329 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5888196b-7bf2-42cc-8ee2-6a26ed3be8be None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:33.601615 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbff402-ae3b-4faa-8450-ca9e0f4e8338 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:33.669133 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e75d83-df9d-438f-9407-346dc59e7a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:33.670338 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e75d83-df9d-438f-9407-346dc59e7a36 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:33.670942 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e75d83-df9d-438f-9407-346dc59e7a36 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:33.671414 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e75d83-df9d-438f-9407-346dc59e7a36 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:33.693875 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e75d83-df9d-438f-9407-346dc59e7a36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 20:32:33.699963 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application [None req-57e75d83-df9d-438f-9407-346dc59e7a36 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 01 20:32:33.699963 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:32:33.699963 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:32:33.699963 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:32:33.699963 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:32:33.699963 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:32:33.699963 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:32:33.699963 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:32:33.699963 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:32:33.699963 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:32:33.699963 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:32:33.699963 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:32:33.699963 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 20:32:33.699963 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 20:32:33.699963 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 20:32:33.699963 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 20:32:33.700865 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 20:32:33.700865 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 20:32:33.700865 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 20:32:33.700865 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 20:32:33.700865 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:32:33.700865 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:32:33.700865 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:32:33.700865 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:32:33.700865 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:32:33.700865 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:32:33.700865 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:32:33.700865 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application with Lock( Oct 01 20:32:33.700865 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:32:33.700865 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:32:33.700865 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:32:33.700865 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:32:33.701651 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:32:33.701651 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:32:33.701651 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:32:33.701651 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:32:33.701651 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 20:32:33.701651 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 20:32:33.701651 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 20:32:33.701651 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 20:32:33.701651 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 20:32:33.701651 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 20:32:33.701651 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 01 20:32:33.701651 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:32:33.704262 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 130/259] 10.222.0.23 () {56 vars in 1114 bytes} [Sat Oct 1 20:32:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:32:33.710638 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e75d83-df9d-438f-9407-346dc59e7a36 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:33.757206 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:33.789996 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5888196b-7bf2-42cc-8ee2-6a26ed3be8be None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:33.817692 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:33.869199 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f84475-207c-4429-bcbf-ce3ba68e4ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:33.869602 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f84475-207c-4429-bcbf-ce3ba68e4ad9 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:33.869890 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f84475-207c-4429-bcbf-ce3ba68e4ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:33.870166 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f84475-207c-4429-bcbf-ce3ba68e4ad9 None admin] PATH_INFO: `/v3/roles` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:33.870844 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f84475-207c-4429-bcbf-ce3ba68e4ad9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:32:33.871151 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f84475-207c-4429-bcbf-ce3ba68e4ad9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:33.872584 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f84475-207c-4429-bcbf-ce3ba68e4ad9 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:33.887586 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e75d83-df9d-438f-9407-346dc59e7a36 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:33.888463 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 130/260] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Oct 1 20:32:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 20:32:33.896516 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f84475-207c-4429-bcbf-ce3ba68e4ad9 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:33.930693 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3f37ba-7c9b-4f73-bbeb-d9eadb149174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:33.931683 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f37ba-7c9b-4f73-bbeb-d9eadb149174 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:33.932152 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f37ba-7c9b-4f73-bbeb-d9eadb149174 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:33.932647 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f37ba-7c9b-4f73-bbeb-d9eadb149174 None admin] PATH_INFO: `/v3/roles` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:33.934063 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3f37ba-7c9b-4f73-bbeb-d9eadb149174 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:32:33.934580 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3f37ba-7c9b-4f73-bbeb-d9eadb149174 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:33.936423 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3f37ba-7c9b-4f73-bbeb-d9eadb149174 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:33.951320 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 131/261] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Oct 1 20:32:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:33.957995 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3f37ba-7c9b-4f73-bbeb-d9eadb149174 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:34.109190 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3f37ba-7c9b-4f73-bbeb-d9eadb149174 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:34.125824 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:34.150658 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a863d20-6cce-4af4-a90d-db42191a0181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:34.151828 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a863d20-6cce-4af4-a90d-db42191a0181 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:34.152299 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a863d20-6cce-4af4-a90d-db42191a0181 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:34.153212 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a863d20-6cce-4af4-a90d-db42191a0181 None admin] PATH_INFO: `/v3/users/7dcfe7da41174f79ae76106ebdaa12bf` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:34.154583 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a863d20-6cce-4af4-a90d-db42191a0181 None admin] RBAC: Authorizing `identity:get_user(user_id=7dcfe7da41174f79ae76106ebdaa12bf)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:34.162483 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a863d20-6cce-4af4-a90d-db42191a0181 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:34.164544 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 132/262] 10.222.0.23 () {56 vars in 1177 bytes} [Sat Oct 1 20:32:33 2022] GET /identity/v3/users/7dcfe7da41174f79ae76106ebdaa12bf => generated 283 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 20:32:34.180304 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a863d20-6cce-4af4-a90d-db42191a0181 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:34.198686 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f84475-207c-4429-bcbf-ce3ba68e4ad9 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:34.293243 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9f6fbb-c244-4677-872a-8ab18677958e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:34.293901 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f6fbb-c244-4677-872a-8ab18677958e None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:34.294176 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f6fbb-c244-4677-872a-8ab18677958e None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:34.294460 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f6fbb-c244-4677-872a-8ab18677958e None admin] PATH_INFO: `/v3/users/7dcfe7da41174f79ae76106ebdaa12bf` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:34.295638 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9f6fbb-c244-4677-872a-8ab18677958e None admin] RBAC: Authorizing `identity:get_user(user_id=7dcfe7da41174f79ae76106ebdaa12bf)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:34.297202 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9f6fbb-c244-4677-872a-8ab18677958e None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:34.299043 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 131/263] 10.222.0.23 () {56 vars in 1177 bytes} [Sat Oct 1 20:32:33 2022] GET /identity/v3/users/7dcfe7da41174f79ae76106ebdaa12bf => generated 283 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 20:32:34.302434 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a863d20-6cce-4af4-a90d-db42191a0181 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:34.304458 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9f6fbb-c244-4677-872a-8ab18677958e None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:34.333988 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:34.346525 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b17040-27fc-46d3-bf68-bf602657f79c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:34.348024 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b17040-27fc-46d3-bf68-bf602657f79c None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:34.348500 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b17040-27fc-46d3-bf68-bf602657f79c None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:34.349188 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b17040-27fc-46d3-bf68-bf602657f79c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:34.441433 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:34.485491 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b17040-27fc-46d3-bf68-bf602657f79c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:34.487001 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b17040-27fc-46d3-bf68-bf602657f79c None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:34.525918 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9f6fbb-c244-4677-872a-8ab18677958e None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:34.565859 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97be7404-ecf6-4a2d-bc68-afbf98c7eead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:34.566811 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be7404-ecf6-4a2d-bc68-afbf98c7eead None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:34.567358 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be7404-ecf6-4a2d-bc68-afbf98c7eead None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:34.567820 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be7404-ecf6-4a2d-bc68-afbf98c7eead None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:34.646484 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97be7404-ecf6-4a2d-bc68-afbf98c7eead None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:34.648293 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97be7404-ecf6-4a2d-bc68-afbf98c7eead None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:34.665199 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:34.743533 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 133/264] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Oct 1 20:32:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 563 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 01 20:32:34.749083 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b17040-27fc-46d3-bf68-bf602657f79c None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:34.764022 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 132/265] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Oct 1 20:32:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 01 20:32:34.770166 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97be7404-ecf6-4a2d-bc68-afbf98c7eead None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:34.882313 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97be7404-ecf6-4a2d-bc68-afbf98c7eead None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:34.899202 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:34.928806 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c8ece7-8d6b-418d-86ac-70129ffe8ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:34.934601 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c8ece7-8d6b-418d-86ac-70129ffe8ac0 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:34.935094 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c8ece7-8d6b-418d-86ac-70129ffe8ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:34.935567 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c8ece7-8d6b-418d-86ac-70129ffe8ac0 None admin] PATH_INFO: `/v3/projects/4357ac4f8a434b11a19fefd8982470d2` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:34.937019 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c8ece7-8d6b-418d-86ac-70129ffe8ac0 None admin] RBAC: Authorizing `identity:get_project(project_id=4357ac4f8a434b11a19fefd8982470d2)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:34.941009 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c8ece7-8d6b-418d-86ac-70129ffe8ac0 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:34.942919 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 133/266] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Oct 1 20:32:34 2022] GET /identity/v3/projects/4357ac4f8a434b11a19fefd8982470d2 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 20:32:34.948824 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c8ece7-8d6b-418d-86ac-70129ffe8ac0 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:34.972136 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:35.026863 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b17040-27fc-46d3-bf68-bf602657f79c None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:35.119073 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d4771f-7299-4e8e-94a8-d0bdcc881da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:35.119710 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d4771f-7299-4e8e-94a8-d0bdcc881da9 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:35.119991 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d4771f-7299-4e8e-94a8-d0bdcc881da9 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:35.120266 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d4771f-7299-4e8e-94a8-d0bdcc881da9 None admin] PATH_INFO: `/v3/projects/4357ac4f8a434b11a19fefd8982470d2` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:35.125847 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d4771f-7299-4e8e-94a8-d0bdcc881da9 None admin] RBAC: Authorizing `identity:get_project(project_id=4357ac4f8a434b11a19fefd8982470d2)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:35.127313 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d4771f-7299-4e8e-94a8-d0bdcc881da9 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:35.129307 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 134/267] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Oct 1 20:32:34 2022] GET /identity/v3/projects/4357ac4f8a434b11a19fefd8982470d2 => generated 302 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 20:32:35.135496 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d4771f-7299-4e8e-94a8-d0bdcc881da9 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:35.219629 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c8ece7-8d6b-418d-86ac-70129ffe8ac0 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:35.317360 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37edb57c-87e9-4de4-a513-0548c2fab972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:35.317898 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37edb57c-87e9-4de4-a513-0548c2fab972 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:35.318185 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37edb57c-87e9-4de4-a513-0548c2fab972 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:35.318736 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37edb57c-87e9-4de4-a513-0548c2fab972 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:35.319468 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37edb57c-87e9-4de4-a513-0548c2fab972 None admin] RBAC: Adding query filter params (role.id=d11e7ba2f1fa41ff8ea8dda2a8d1466f, scope.project.id=4357ac4f8a434b11a19fefd8982470d2, user.id=7dcfe7da41174f79ae76106ebdaa12bf) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:32:35.319775 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37edb57c-87e9-4de4-a513-0548c2fab972 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:35.321249 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37edb57c-87e9-4de4-a513-0548c2fab972 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:35.334586 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 134/268] 10.222.0.23 () {56 vars in 1374 bytes} [Sat Oct 1 20:32:34 2022] GET /identity/v3/role_assignments?user.id=7dcfe7da41174f79ae76106ebdaa12bf&scope.project.id=4357ac4f8a434b11a19fefd8982470d2&role.id=d11e7ba2f1fa41ff8ea8dda2a8d1466f => generated 608 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:35.352636 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d4771f-7299-4e8e-94a8-d0bdcc881da9 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:35.414991 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9aa3cc-8f31-4d93-ba1c-c039bbe9d858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:35.415621 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9aa3cc-8f31-4d93-ba1c-c039bbe9d858 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:35.415897 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9aa3cc-8f31-4d93-ba1c-c039bbe9d858 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:35.416167 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9aa3cc-8f31-4d93-ba1c-c039bbe9d858 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:35.416933 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9aa3cc-8f31-4d93-ba1c-c039bbe9d858 None admin] RBAC: Adding query filter params (role.id=8789e127ff4549b4883a92a87573ad3e, scope.project.id=4357ac4f8a434b11a19fefd8982470d2, user.id=7dcfe7da41174f79ae76106ebdaa12bf) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:32:35.417240 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9aa3cc-8f31-4d93-ba1c-c039bbe9d858 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:35.418753 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9aa3cc-8f31-4d93-ba1c-c039bbe9d858 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:35.432083 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 135/269] 10.222.0.23 () {56 vars in 1374 bytes} [Sat Oct 1 20:32:35 2022] GET /identity/v3/role_assignments?user.id=7dcfe7da41174f79ae76106ebdaa12bf&scope.project.id=4357ac4f8a434b11a19fefd8982470d2&role.id=8789e127ff4549b4883a92a87573ad3e => generated 608 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 20:32:35.809878 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b630a4d-37b8-4630-8a86-d83a33a54014 None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:35.810391 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b630a4d-37b8-4630-8a86-d83a33a54014 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:35.810465 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b630a4d-37b8-4630-8a86-d83a33a54014 None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:35.812063 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 135/270] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:32:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:32:35.818131 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b635410-a78c-48c4-ad48-67ba698c1954 None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:35.818837 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b635410-a78c-48c4-ad48-67ba698c1954 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:35.819015 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b635410-a78c-48c4-ad48-67ba698c1954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:35.846737 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-9b635410-a78c-48c4-ad48-67ba698c1954 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:32:35.847950 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-9b635410-a78c-48c4-ad48-67ba698c1954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:32:35.861121 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:35.926363 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 136/271] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:32:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 20:32:36.207297 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245968a4-a225-4e67-9c8c-cd2795f394e9 None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:36.208058 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245968a4-a225-4e67-9c8c-cd2795f394e9 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:36.208588 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245968a4-a225-4e67-9c8c-cd2795f394e9 None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:36.210393 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 136/272] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:32:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:32:36.216003 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba1d3f-25ce-46f3-8664-b7135348da08 None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:36.216582 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba1d3f-25ce-46f3-8664-b7135348da08 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:36.217061 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba1d3f-25ce-46f3-8664-b7135348da08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:36.236137 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-dcba1d3f-25ce-46f3-8664-b7135348da08 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:32:36.237727 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-dcba1d3f-25ce-46f3-8664-b7135348da08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:32:36.266398 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245968a4-a225-4e67-9c8c-cd2795f394e9 None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:36.317388 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 137/273] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:32:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 20:32:36.323552 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:36.386348 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245968a4-a225-4e67-9c8c-cd2795f394e9 None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:36.422882 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bf03b5-ec3a-4a73-a132-980b8179e577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:36.423805 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf03b5-ec3a-4a73-a132-980b8179e577 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:36.424225 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf03b5-ec3a-4a73-a132-980b8179e577 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:36.424676 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf03b5-ec3a-4a73-a132-980b8179e577 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:36.435479 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bf03b5-ec3a-4a73-a132-980b8179e577 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 20:32:36.441557 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-47bf03b5-ec3a-4a73-a132-980b8179e577 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 01 20:32:36.441557 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:32:36.441557 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:32:36.441557 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:32:36.441557 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:32:36.441557 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:32:36.441557 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:32:36.441557 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:32:36.441557 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:32:36.441557 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:32:36.441557 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:32:36.441557 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:32:36.441557 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 20:32:36.441557 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 20:32:36.441557 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 20:32:36.441557 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 20:32:36.442598 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 20:32:36.442598 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 20:32:36.442598 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 20:32:36.442598 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 20:32:36.442598 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:32:36.442598 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:32:36.442598 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:32:36.442598 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:32:36.442598 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:32:36.442598 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:32:36.442598 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:32:36.442598 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:32:36.442598 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:32:36.442598 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:32:36.442598 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:32:36.442598 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:32:36.443839 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:32:36.443839 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:32:36.443839 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:32:36.443839 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:32:36.443839 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 20:32:36.443839 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 20:32:36.443839 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 20:32:36.443839 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 20:32:36.443839 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 20:32:36.443839 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 20:32:36.443839 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 01 20:32:36.443839 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:32:36.445634 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 137/274] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Oct 1 20:32:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 01 20:32:36.454366 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba1d3f-25ce-46f3-8664-b7135348da08 None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:36.496573 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d184fe7-5081-4842-a359-3f8e37a740ed None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:36.496861 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d184fe7-5081-4842-a359-3f8e37a740ed None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:36.497135 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d184fe7-5081-4842-a359-3f8e37a740ed None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:36.498867 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 138/275] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:32:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 01 20:32:36.504656 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a071ad8c-4256-41be-b2c5-6f51557acada None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:36.505165 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a071ad8c-4256-41be-b2c5-6f51557acada None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:36.505645 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a071ad8c-4256-41be-b2c5-6f51557acada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:36.523745 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-a071ad8c-4256-41be-b2c5-6f51557acada None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:32:36.525235 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-a071ad8c-4256-41be-b2c5-6f51557acada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:32:36.533829 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:36.565629 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba1d3f-25ce-46f3-8664-b7135348da08 None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:36.600405 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 139/276] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:32:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 20:32:36.603662 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd1c76f-c3a6-4a76-9f5d-03420b8c89db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:36.604486 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd1c76f-c3a6-4a76-9f5d-03420b8c89db None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:36.604985 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd1c76f-c3a6-4a76-9f5d-03420b8c89db None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:36.605467 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd1c76f-c3a6-4a76-9f5d-03420b8c89db None admin] PATH_INFO: `/v3/roles` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:36.606344 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd1c76f-c3a6-4a76-9f5d-03420b8c89db None admin] RBAC: Adding query filter params (name=reader) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:32:36.606839 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd1c76f-c3a6-4a76-9f5d-03420b8c89db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:36.608402 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd1c76f-c3a6-4a76-9f5d-03420b8c89db None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:36.620395 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 138/277] 10.222.0.23 () {56 vars in 1101 bytes} [Sat Oct 1 20:32:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:36.629595 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a071ad8c-4256-41be-b2c5-6f51557acada None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:36.667469 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:36.677312 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd1c76f-c3a6-4a76-9f5d-03420b8c89db None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:36.742201 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a071ad8c-4256-41be-b2c5-6f51557acada None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:36.778071 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e7430-7d53-4579-848b-33d0d85ac484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:36.778796 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e7430-7d53-4579-848b-33d0d85ac484 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:36.779071 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e7430-7d53-4579-848b-33d0d85ac484 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:36.779337 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e7430-7d53-4579-848b-33d0d85ac484 None admin] PATH_INFO: `/v3/users/81fdf771f81049ad98e41f1ea383514a` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:36.780487 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001e7430-7d53-4579-848b-33d0d85ac484 None admin] RBAC: Authorizing `identity:get_user(user_id=81fdf771f81049ad98e41f1ea383514a)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:36.782542 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001e7430-7d53-4579-848b-33d0d85ac484 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:36.784309 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 140/278] 10.222.0.23 () {56 vars in 1177 bytes} [Sat Oct 1 20:32:36 2022] GET /identity/v3/users/81fdf771f81049ad98e41f1ea383514a => generated 297 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:36.788814 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd1c76f-c3a6-4a76-9f5d-03420b8c89db None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:36.791155 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e7430-7d53-4579-848b-33d0d85ac484 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:36.832144 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca977b5-a817-465d-bbf1-d2765be20259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:36.832866 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca977b5-a817-465d-bbf1-d2765be20259 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:36.833152 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca977b5-a817-465d-bbf1-d2765be20259 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:36.833420 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca977b5-a817-465d-bbf1-d2765be20259 None admin] PATH_INFO: `/v3/domains/default` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:36.834519 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca977b5-a817-465d-bbf1-d2765be20259 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:36.835997 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca977b5-a817-465d-bbf1-d2765be20259 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:36.841917 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 139/279] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Oct 1 20:32:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 20:32:36.843517 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef8660-549f-46df-a9ec-0632da55bc02 None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:36.843788 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef8660-549f-46df-a9ec-0632da55bc02 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:36.844100 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef8660-549f-46df-a9ec-0632da55bc02 None None] PATH_INFO: `/` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:36.845424 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 140/280] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:32:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:32:36.849682 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ef8660-549f-46df-a9ec-0632da55bc02 None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:36.850616 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:36.910716 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e7430-7d53-4579-848b-33d0d85ac484 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:36.914742 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:36.950609 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5953aa9-2c95-494c-a720-147e49ad908d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:36.951564 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5953aa9-2c95-494c-a720-147e49ad908d None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:36.952060 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5953aa9-2c95-494c-a720-147e49ad908d None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:36.952575 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5953aa9-2c95-494c-a720-147e49ad908d None admin] PATH_INFO: `/v3/projects/4357ac4f8a434b11a19fefd8982470d2` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:36.955183 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5953aa9-2c95-494c-a720-147e49ad908d None admin] RBAC: Authorizing `identity:get_project(project_id=4357ac4f8a434b11a19fefd8982470d2)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:36.956747 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5953aa9-2c95-494c-a720-147e49ad908d None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:36.959648 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 141/281] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Oct 1 20:32:36 2022] GET /identity/v3/projects/4357ac4f8a434b11a19fefd8982470d2 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:36.960833 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01cba66-9653-4e4f-8d4f-af5b899362e9 None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:36.961119 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01cba66-9653-4e4f-8d4f-af5b899362e9 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:36.961393 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01cba66-9653-4e4f-8d4f-af5b899362e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:36.962625 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ef8660-549f-46df-a9ec-0632da55bc02 None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:36.981246 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-e01cba66-9653-4e4f-8d4f-af5b899362e9 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:32:36.982454 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-e01cba66-9653-4e4f-8d4f-af5b899362e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:32:37.001142 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3fc600-668b-47b4-97ad-0d95eb504124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:37.001750 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3fc600-668b-47b4-97ad-0d95eb504124 None admin] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:37.002035 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3fc600-668b-47b4-97ad-0d95eb504124 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:37.002306 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3fc600-668b-47b4-97ad-0d95eb504124 None admin] PATH_INFO: `/v3/users` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:37.002946 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3fc600-668b-47b4-97ad-0d95eb504124 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:37.004389 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3fc600-668b-47b4-97ad-0d95eb504124 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:37.026819 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 141/282] 10.222.0.23 () {60 vars in 1132 bytes} [Sat Oct 1 20:32:36 2022] POST /identity/v3/users => generated 293 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 20:32:37.026819 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3fc600-668b-47b4-97ad-0d95eb504124 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:37.079455 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 142/283] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:32:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 20:32:37.080588 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01cba66-9653-4e4f-8d4f-af5b899362e9 None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:37.116222 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:37.181444 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3fc600-668b-47b4-97ad-0d95eb504124 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:37.228318 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9dd7f1-1915-4194-b9ae-05d0996c7fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:37.228906 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9dd7f1-1915-4194-b9ae-05d0996c7fd3 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:37.229181 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9dd7f1-1915-4194-b9ae-05d0996c7fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:37.229449 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9dd7f1-1915-4194-b9ae-05d0996c7fd3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:37.235111 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01cba66-9653-4e4f-8d4f-af5b899362e9 None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:37.237369 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:37.245037 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9dd7f1-1915-4194-b9ae-05d0996c7fd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 20:32:37.254485 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application [None req-5f9dd7f1-1915-4194-b9ae-05d0996c7fd3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 01 20:32:37.254485 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:32:37.254485 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:32:37.254485 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:32:37.254485 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:32:37.254485 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:32:37.254485 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:32:37.254485 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:32:37.254485 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:32:37.254485 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:32:37.254485 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:32:37.254485 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:32:37.254485 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 20:32:37.254485 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 20:32:37.254485 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 20:32:37.254485 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 20:32:37.255433 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 20:32:37.255433 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 20:32:37.255433 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 20:32:37.255433 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 20:32:37.255433 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:32:37.255433 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:32:37.255433 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:32:37.255433 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:32:37.255433 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:32:37.255433 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:32:37.255433 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:32:37.255433 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application with Lock( Oct 01 20:32:37.255433 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:32:37.255433 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:32:37.255433 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:32:37.255433 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:32:37.257608 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:32:37.257608 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:32:37.257608 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:32:37.257608 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:32:37.257608 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 20:32:37.257608 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 20:32:37.257608 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 20:32:37.257608 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 20:32:37.257608 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 20:32:37.257608 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 20:32:37.257608 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 01 20:32:37.257608 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:32:37.258437 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 142/284] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Oct 1 20:32:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:32:37.269482 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9dd7f1-1915-4194-b9ae-05d0996c7fd3 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:37.281668 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a06fe01-4147-4c3d-9b69-b6f6533e5c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:37.283218 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a06fe01-4147-4c3d-9b69-b6f6533e5c2a None admin] REQUEST_METHOD: `PUT` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:37.283507 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a06fe01-4147-4c3d-9b69-b6f6533e5c2a None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:37.283774 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a06fe01-4147-4c3d-9b69-b6f6533e5c2a None admin] PATH_INFO: `/v3/projects/4357ac4f8a434b11a19fefd8982470d2/users/81fdf771f81049ad98e41f1ea383514a/roles/593409d904954a0f8039eda5aa05fc40` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:37.286518 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a06fe01-4147-4c3d-9b69-b6f6533e5c2a None admin] RBAC: Authorizing `identity:create_grant(project_id=4357ac4f8a434b11a19fefd8982470d2, user_id=81fdf771f81049ad98e41f1ea383514a, role_id=593409d904954a0f8039eda5aa05fc40)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:37.287845 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a06fe01-4147-4c3d-9b69-b6f6533e5c2a None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:37.305769 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 143/285] 10.222.0.23 () {58 vars in 1439 bytes} [Sat Oct 1 20:32:37 2022] PUT /identity/v3/projects/4357ac4f8a434b11a19fefd8982470d2/users/81fdf771f81049ad98e41f1ea383514a/roles/593409d904954a0f8039eda5aa05fc40 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 20:32:37.403405 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9dd7f1-1915-4194-b9ae-05d0996c7fd3 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:37.416387 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a06fe01-4147-4c3d-9b69-b6f6533e5c2a None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:37.430296 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:37.447982 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c96a9d8-94c6-41d3-b126-c9a8a95ab32b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:37.448687 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c96a9d8-94c6-41d3-b126-c9a8a95ab32b None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:37.448961 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c96a9d8-94c6-41d3-b126-c9a8a95ab32b None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:37.449230 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c96a9d8-94c6-41d3-b126-c9a8a95ab32b None admin] PATH_INFO: `/v3/roles` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:37.449906 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c96a9d8-94c6-41d3-b126-c9a8a95ab32b None admin] RBAC: Adding query filter params (name=member) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:32:37.450205 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c96a9d8-94c6-41d3-b126-c9a8a95ab32b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:37.451604 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c96a9d8-94c6-41d3-b126-c9a8a95ab32b None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:37.462669 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 143/286] 10.222.0.23 () {56 vars in 1101 bytes} [Sat Oct 1 20:32:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:37.470283 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c96a9d8-94c6-41d3-b126-c9a8a95ab32b None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:37.570858 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a06fe01-4147-4c3d-9b69-b6f6533e5c2a None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:37.599773 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c96a9d8-94c6-41d3-b126-c9a8a95ab32b None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:37.621229 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b02dd2-a011-46c9-8f0d-8f654fca1373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:37.622393 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b02dd2-a011-46c9-8f0d-8f654fca1373 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:37.623230 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b02dd2-a011-46c9-8f0d-8f654fca1373 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:37.623688 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b02dd2-a011-46c9-8f0d-8f654fca1373 None admin] PATH_INFO: `/v3/roles/member` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:37.636828 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b02dd2-a011-46c9-8f0d-8f654fca1373 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 20:32:37.641391 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a6cc8f-a792-4154-aeb2-147fd58f4f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:37.642027 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a6cc8f-a792-4154-aeb2-147fd58f4f41 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:37.642307 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a6cc8f-a792-4154-aeb2-147fd58f4f41 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:37.642582 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a6cc8f-a792-4154-aeb2-147fd58f4f41 None admin] PATH_INFO: `/v3/users/eb73536d72f346c6bdf0d81af4681629` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:37.645323 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-20b02dd2-a011-46c9-8f0d-8f654fca1373 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 01 20:32:37.645323 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:32:37.645323 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:32:37.645323 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:32:37.645323 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:32:37.645323 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:32:37.645323 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:32:37.645323 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:32:37.645323 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:32:37.645323 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:32:37.645323 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:32:37.645323 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:32:37.645323 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 20:32:37.645323 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 20:32:37.645323 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 20:32:37.645323 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 20:32:37.646188 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 20:32:37.646188 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 20:32:37.646188 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 20:32:37.646188 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 20:32:37.646188 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:32:37.646188 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:32:37.646188 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:32:37.646188 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:32:37.646188 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:32:37.646188 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:32:37.646188 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:32:37.646188 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:32:37.646188 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:32:37.646188 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:32:37.646188 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:32:37.646188 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:32:37.646986 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:32:37.646986 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:32:37.646986 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:32:37.646986 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:32:37.646986 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 20:32:37.646986 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 20:32:37.646986 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 20:32:37.646986 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 20:32:37.646986 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 20:32:37.646986 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 20:32:37.646986 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 01 20:32:37.646986 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:32:37.649864 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 144/287] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Oct 1 20:32:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 01 20:32:37.657279 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b02dd2-a011-46c9-8f0d-8f654fca1373 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:37.660498 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a6cc8f-a792-4154-aeb2-147fd58f4f41 None admin] RBAC: Authorizing `identity:get_user(user_id=eb73536d72f346c6bdf0d81af4681629)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:37.662967 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a6cc8f-a792-4154-aeb2-147fd58f4f41 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:37.664660 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 144/288] 10.222.0.23 () {56 vars in 1177 bytes} [Sat Oct 1 20:32:37 2022] GET /identity/v3/users/eb73536d72f346c6bdf0d81af4681629 => generated 293 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 20:32:37.675505 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a6cc8f-a792-4154-aeb2-147fd58f4f41 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:37.704444 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:37.735970 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:37.798248 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a6cc8f-a792-4154-aeb2-147fd58f4f41 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:37.862945 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b02dd2-a011-46c9-8f0d-8f654fca1373 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:37.866109 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff2b8fd-6670-4c4a-b8ac-fe4f7c11c0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:37.866711 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff2b8fd-6670-4c4a-b8ac-fe4f7c11c0d8 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:37.866986 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff2b8fd-6670-4c4a-b8ac-fe4f7c11c0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:37.867253 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff2b8fd-6670-4c4a-b8ac-fe4f7c11c0d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:37.867968 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff2b8fd-6670-4c4a-b8ac-fe4f7c11c0d8 None admin] RBAC: Adding query filter params (role.id=82138515a02147ccb30f8d56863aab87, user.id=eb73536d72f346c6bdf0d81af4681629, scope.system=all) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:32:37.868269 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff2b8fd-6670-4c4a-b8ac-fe4f7c11c0d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:37.869731 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff2b8fd-6670-4c4a-b8ac-fe4f7c11c0d8 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:37.884266 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 145/289] 10.222.0.23 () {56 vars in 1308 bytes} [Sat Oct 1 20:32:37 2022] GET /identity/v3/role_assignments?user.id=eb73536d72f346c6bdf0d81af4681629&scope.system=all&role.id=82138515a02147ccb30f8d56863aab87 => generated 226 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 20:32:37.931370 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ada1e1-d20d-4780-8419-11a86c0c9060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:37.932051 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ada1e1-d20d-4780-8419-11a86c0c9060 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:37.932258 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ada1e1-d20d-4780-8419-11a86c0c9060 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:37.932631 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ada1e1-d20d-4780-8419-11a86c0c9060 None admin] PATH_INFO: `/v3/roles` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:37.933314 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ada1e1-d20d-4780-8419-11a86c0c9060 None admin] RBAC: Adding query filter params (name=member) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:32:37.933612 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ada1e1-d20d-4780-8419-11a86c0c9060 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:37.935013 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ada1e1-d20d-4780-8419-11a86c0c9060 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:37.945679 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 145/290] 10.222.0.23 () {56 vars in 1101 bytes} [Sat Oct 1 20:32:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:37.951646 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff2b8fd-6670-4c4a-b8ac-fe4f7c11c0d8 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:38.117927 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff2b8fd-6670-4c4a-b8ac-fe4f7c11c0d8 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:38.121276 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:38.169619 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbd3a5c-caf9-4bf7-af0f-5c7482fbc7cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:38.170258 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd3a5c-caf9-4bf7-af0f-5c7482fbc7cf None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:38.176812 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd3a5c-caf9-4bf7-af0f-5c7482fbc7cf None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:38.177131 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd3a5c-caf9-4bf7-af0f-5c7482fbc7cf None admin] PATH_INFO: `/v3/users/eb58a3d5969d4fc0b0ea5814841e6268` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:38.178384 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbd3a5c-caf9-4bf7-af0f-5c7482fbc7cf None admin] RBAC: Authorizing `identity:get_user(user_id=eb58a3d5969d4fc0b0ea5814841e6268)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:38.179854 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbd3a5c-caf9-4bf7-af0f-5c7482fbc7cf None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:38.181813 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 146/291] 10.222.0.23 () {56 vars in 1177 bytes} [Sat Oct 1 20:32:37 2022] GET /identity/v3/users/eb58a3d5969d4fc0b0ea5814841e6268 => generated 297 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:38.187866 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ada1e1-d20d-4780-8419-11a86c0c9060 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:38.330159 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:38.352338 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ada1e1-d20d-4780-8419-11a86c0c9060 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:38.400660 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f583659-164b-4c34-8c41-a8ae414d4139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:38.401187 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f583659-164b-4c34-8c41-a8ae414d4139 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:38.401463 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f583659-164b-4c34-8c41-a8ae414d4139 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:38.401730 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f583659-164b-4c34-8c41-a8ae414d4139 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:38.490791 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f583659-164b-4c34-8c41-a8ae414d4139 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:38.492267 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f583659-164b-4c34-8c41-a8ae414d4139 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:38.601961 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:38.629421 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 146/292] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Oct 1 20:32:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 01 20:32:38.635134 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbd3a5c-caf9-4bf7-af0f-5c7482fbc7cf None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:38.776408 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbd3a5c-caf9-4bf7-af0f-5c7482fbc7cf None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:38.824623 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059b5e8e-1adf-49e1-9052-bee6e9544ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:38.825297 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b5e8e-1adf-49e1-9052-bee6e9544ac6 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:38.825573 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b5e8e-1adf-49e1-9052-bee6e9544ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:38.825873 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b5e8e-1adf-49e1-9052-bee6e9544ac6 None admin] PATH_INFO: `/v3/projects/4357ac4f8a434b11a19fefd8982470d2` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:38.826961 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059b5e8e-1adf-49e1-9052-bee6e9544ac6 None admin] RBAC: Authorizing `identity:get_project(project_id=4357ac4f8a434b11a19fefd8982470d2)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:38.828739 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059b5e8e-1adf-49e1-9052-bee6e9544ac6 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:38.830414 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 147/293] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Oct 1 20:32:38 2022] GET /identity/v3/projects/4357ac4f8a434b11a19fefd8982470d2 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:38.836659 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f583659-164b-4c34-8c41-a8ae414d4139 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:38.952915 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f583659-164b-4c34-8c41-a8ae414d4139 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:38.998891 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a8b337-fc72-4e09-ae4a-94627cc3949c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:38.999532 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a8b337-fc72-4e09-ae4a-94627cc3949c None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:38.999938 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a8b337-fc72-4e09-ae4a-94627cc3949c None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:39.000207 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a8b337-fc72-4e09-ae4a-94627cc3949c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:39.000967 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a8b337-fc72-4e09-ae4a-94627cc3949c None admin] RBAC: Adding query filter params (role.id=82138515a02147ccb30f8d56863aab87, scope.project.id=4357ac4f8a434b11a19fefd8982470d2, user.id=eb58a3d5969d4fc0b0ea5814841e6268) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:32:39.001270 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a8b337-fc72-4e09-ae4a-94627cc3949c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:39.002794 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a8b337-fc72-4e09-ae4a-94627cc3949c None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:39.012655 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 147/294] 10.222.0.23 () {56 vars in 1374 bytes} [Sat Oct 1 20:32:38 2022] GET /identity/v3/role_assignments?user.id=eb58a3d5969d4fc0b0ea5814841e6268&scope.project.id=4357ac4f8a434b11a19fefd8982470d2&role.id=82138515a02147ccb30f8d56863aab87 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:40.191205 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f687248-ec18-4e8b-80e5-ecd3ae8251c1 None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:40.191710 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f687248-ec18-4e8b-80e5-ecd3ae8251c1 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:40.191710 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f687248-ec18-4e8b-80e5-ecd3ae8251c1 None None] PATH_INFO: `/` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:40.193496 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 148/295] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:32:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:32:40.198630 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c7a06b-3b6c-4954-aa3d-b6e3a9743721 None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:40.199051 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c7a06b-3b6c-4954-aa3d-b6e3a9743721 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:40.199237 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c7a06b-3b6c-4954-aa3d-b6e3a9743721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:40.217726 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-34c7a06b-3b6c-4954-aa3d-b6e3a9743721 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:32:40.219568 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-34c7a06b-3b6c-4954-aa3d-b6e3a9743721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:32:40.223446 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6b462b-a2f5-4e13-a462-bb3cd00cebbc None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:40.223728 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6b462b-a2f5-4e13-a462-bb3cd00cebbc None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:40.223994 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6b462b-a2f5-4e13-a462-bb3cd00cebbc None None] PATH_INFO: `/` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:40.225612 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 149/296] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:32:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:32:40.231402 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de0374-c6cb-4c81-b29c-d2484422ecc8 None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:40.231677 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de0374-c6cb-4c81-b29c-d2484422ecc8 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:40.231939 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de0374-c6cb-4c81-b29c-d2484422ecc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:40.251790 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-53de0374-c6cb-4c81-b29c-d2484422ecc8 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:32:40.253003 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-53de0374-c6cb-4c81-b29c-d2484422ecc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:32:40.273683 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:40.292858 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:40.297405 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 148/297] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:32:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 20:32:40.304791 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a27aac-a439-43a3-bf10-ecc67318efdd None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:40.304791 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a27aac-a439-43a3-bf10-ecc67318efdd None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:40.304791 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a27aac-a439-43a3-bf10-ecc67318efdd None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:40.304791 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 149/298] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:32:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:32:40.306406 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eece9a-4813-4702-8e27-d5021e951517 None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:40.306928 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eece9a-4813-4702-8e27-d5021e951517 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:40.307523 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eece9a-4813-4702-8e27-d5021e951517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:40.333559 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-50eece9a-4813-4702-8e27-d5021e951517 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:32:40.335134 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 150/299] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:32:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 20:32:40.335247 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-50eece9a-4813-4702-8e27-d5021e951517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:32:40.413211 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 150/300] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:32:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 20:32:40.628849 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53de0374-c6cb-4c81-b29c-d2484422ecc8 None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:40.668427 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eece9a-4813-4702-8e27-d5021e951517 None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:40.737966 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53de0374-c6cb-4c81-b29c-d2484422ecc8 None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:40.775159 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed3f426-0214-4d67-90d8-8acb35f8ba63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:40.775796 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed3f426-0214-4d67-90d8-8acb35f8ba63 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:40.776073 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed3f426-0214-4d67-90d8-8acb35f8ba63 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:40.776344 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed3f426-0214-4d67-90d8-8acb35f8ba63 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:40.788277 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed3f426-0214-4d67-90d8-8acb35f8ba63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 20:32:40.789929 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eece9a-4813-4702-8e27-d5021e951517 None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:40.793066 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application [None req-1ed3f426-0214-4d67-90d8-8acb35f8ba63 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 01 20:32:40.793066 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:32:40.793066 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:32:40.793066 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:32:40.793066 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:32:40.793066 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:32:40.793066 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:32:40.793066 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:32:40.793066 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:32:40.793066 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:32:40.793066 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:32:40.793066 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:32:40.793066 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 20:32:40.793066 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 20:32:40.793066 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 20:32:40.793066 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 20:32:40.794110 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 20:32:40.794110 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 20:32:40.794110 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 20:32:40.794110 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 20:32:40.794110 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:32:40.794110 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:32:40.794110 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:32:40.794110 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:32:40.794110 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:32:40.794110 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:32:40.794110 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:32:40.794110 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application with Lock( Oct 01 20:32:40.794110 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:32:40.794110 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:32:40.794110 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:32:40.794110 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:32:40.795109 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:32:40.795109 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:32:40.795109 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:32:40.795109 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:32:40.795109 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 20:32:40.795109 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 20:32:40.795109 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 20:32:40.795109 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 20:32:40.795109 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 20:32:40.795109 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 20:32:40.795109 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 01 20:32:40.795109 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:32:40.798674 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 151/301] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Oct 1 20:32:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:32:40.798674 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed3f426-0214-4d67-90d8-8acb35f8ba63 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:40.800454 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:40.825424 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cda2d9-7195-48a2-8587-8773f62dafb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:40.826044 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cda2d9-7195-48a2-8587-8773f62dafb6 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:40.826315 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cda2d9-7195-48a2-8587-8773f62dafb6 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:40.826582 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cda2d9-7195-48a2-8587-8773f62dafb6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:40.827743 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cda2d9-7195-48a2-8587-8773f62dafb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:40.829295 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:40.829405 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cda2d9-7195-48a2-8587-8773f62dafb6 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:40.831031 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 151/302] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Oct 1 20:32:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:40.832162 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e946d5b7-e2ed-4ffa-b5c6-194d01c8d462 None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:40.832439 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e946d5b7-e2ed-4ffa-b5c6-194d01c8d462 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:40.832753 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e946d5b7-e2ed-4ffa-b5c6-194d01c8d462 None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:40.834035 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 152/303] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:32:40 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:32:40.834573 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e946d5b7-e2ed-4ffa-b5c6-194d01c8d462 None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:40.902885 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed3f426-0214-4d67-90d8-8acb35f8ba63 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:40.934828 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e946d5b7-e2ed-4ffa-b5c6-194d01c8d462 None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:40.936162 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d829d85-bc46-4c9e-a035-dcfa5c51f267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:40.936837 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d829d85-bc46-4c9e-a035-dcfa5c51f267 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:40.937722 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d829d85-bc46-4c9e-a035-dcfa5c51f267 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:40.937989 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d829d85-bc46-4c9e-a035-dcfa5c51f267 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:40.948989 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d829d85-bc46-4c9e-a035-dcfa5c51f267 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 20:32:40.953928 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application [None req-3d829d85-bc46-4c9e-a035-dcfa5c51f267 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 01 20:32:40.953928 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:32:40.953928 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:32:40.953928 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:32:40.953928 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:32:40.953928 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:32:40.953928 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:32:40.953928 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:32:40.953928 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:32:40.953928 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:32:40.953928 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:32:40.953928 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:32:40.953928 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 20:32:40.953928 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 20:32:40.953928 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 20:32:40.953928 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 20:32:40.954876 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 20:32:40.954876 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 20:32:40.954876 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 20:32:40.954876 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 20:32:40.954876 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:32:40.954876 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:32:40.954876 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:32:40.954876 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:32:40.954876 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:32:40.954876 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:32:40.954876 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:32:40.954876 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application with Lock( Oct 01 20:32:40.954876 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:32:40.954876 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:32:40.954876 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:32:40.954876 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:32:40.955672 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:32:40.955672 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:32:40.955672 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:32:40.955672 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:32:40.955672 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 20:32:40.955672 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 20:32:40.955672 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 20:32:40.955672 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 20:32:40.955672 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 20:32:40.955672 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 20:32:40.955672 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 01 20:32:40.955672 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:32:40.955672 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 152/304] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Oct 1 20:32:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:32:40.957123 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d829d85-bc46-4c9e-a035-dcfa5c51f267 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:40.970347 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e695fa10-ff68-40bf-aa4c-83ac724aa175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:40.970944 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e695fa10-ff68-40bf-aa4c-83ac724aa175 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:40.971220 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e695fa10-ff68-40bf-aa4c-83ac724aa175 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:40.971487 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e695fa10-ff68-40bf-aa4c-83ac724aa175 None admin] PATH_INFO: `/v3/roles` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:40.972139 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e695fa10-ff68-40bf-aa4c-83ac724aa175 None admin] RBAC: Adding query filter params (name=reader) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:32:40.972437 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e695fa10-ff68-40bf-aa4c-83ac724aa175 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:40.973843 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e695fa10-ff68-40bf-aa4c-83ac724aa175 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:40.982037 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 153/305] 10.222.0.23 () {56 vars in 1101 bytes} [Sat Oct 1 20:32:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:40.983174 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcee14a-1434-477c-8fdd-553346970bbe None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:40.983456 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcee14a-1434-477c-8fdd-553346970bbe None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:40.983758 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcee14a-1434-477c-8fdd-553346970bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:41.001657 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-6dcee14a-1434-477c-8fdd-553346970bbe None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:32:41.002833 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-6dcee14a-1434-477c-8fdd-553346970bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:32:41.033480 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:41.049405 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:41.059356 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d829d85-bc46-4c9e-a035-dcfa5c51f267 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:41.071148 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 154/306] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:32:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 20:32:41.071968 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcee14a-1434-477c-8fdd-553346970bbe None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:41.095595 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8b8592-0986-4391-956e-795a5020bed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:41.096359 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b8592-0986-4391-956e-795a5020bed7 None admin] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:41.096672 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b8592-0986-4391-956e-795a5020bed7 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:41.097265 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b8592-0986-4391-956e-795a5020bed7 None admin] PATH_INFO: `/v3/groups` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:41.098167 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8b8592-0986-4391-956e-795a5020bed7 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:41.100091 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8b8592-0986-4391-956e-795a5020bed7 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:41.117447 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 153/307] 10.222.0.23 () {60 vars in 1134 bytes} [Sat Oct 1 20:32:40 2022] POST /identity/v3/groups => generated 229 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 20:32:41.118322 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8b8592-0986-4391-956e-795a5020bed7 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:41.200544 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcee14a-1434-477c-8fdd-553346970bbe None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:41.246253 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c303d3-815b-4f2b-b754-5a789544d8e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:41.246875 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c303d3-815b-4f2b-b754-5a789544d8e4 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:41.247160 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c303d3-815b-4f2b-b754-5a789544d8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:41.247437 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c303d3-815b-4f2b-b754-5a789544d8e4 None admin] PATH_INFO: `/v3/roles` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:41.248211 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c303d3-815b-4f2b-b754-5a789544d8e4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:32:41.248542 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c303d3-815b-4f2b-b754-5a789544d8e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:41.250195 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c303d3-815b-4f2b-b754-5a789544d8e4 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:41.259543 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 155/308] 10.222.0.23 () {56 vars in 1101 bytes} [Sat Oct 1 20:32:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:41.266514 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c303d3-815b-4f2b-b754-5a789544d8e4 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:41.293681 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8b8592-0986-4391-956e-795a5020bed7 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:41.303696 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:41.349522 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817bc784-2603-4f51-b15e-359a3a3db1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:41.350455 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817bc784-2603-4f51-b15e-359a3a3db1d9 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:41.350732 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817bc784-2603-4f51-b15e-359a3a3db1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:41.351637 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817bc784-2603-4f51-b15e-359a3a3db1d9 None admin] PATH_INFO: `/v3/users/c0a3f05f6e5849339c0dbb4b15c93ead` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:41.372912 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817bc784-2603-4f51-b15e-359a3a3db1d9 None admin] RBAC: Authorizing `identity:get_user(user_id=c0a3f05f6e5849339c0dbb4b15c93ead)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:41.374959 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817bc784-2603-4f51-b15e-359a3a3db1d9 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:41.376676 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 154/309] 10.222.0.23 () {56 vars in 1177 bytes} [Sat Oct 1 20:32:41 2022] GET /identity/v3/users/c0a3f05f6e5849339c0dbb4b15c93ead => generated 293 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:41.383806 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817bc784-2603-4f51-b15e-359a3a3db1d9 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:41.395930 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:41.398605 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c303d3-815b-4f2b-b754-5a789544d8e4 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:41.440936 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78a479d-2c32-4bd2-9720-31532253a9ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:41.441489 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78a479d-2c32-4bd2-9720-31532253a9ac None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:41.441769 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78a479d-2c32-4bd2-9720-31532253a9ac None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:41.442108 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78a479d-2c32-4bd2-9720-31532253a9ac None admin] PATH_INFO: `/v3/users/81fdf771f81049ad98e41f1ea383514a` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:41.443507 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78a479d-2c32-4bd2-9720-31532253a9ac None admin] RBAC: Authorizing `identity:get_user(user_id=81fdf771f81049ad98e41f1ea383514a)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:41.444998 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78a479d-2c32-4bd2-9720-31532253a9ac None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:41.446835 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 156/310] 10.222.0.23 () {56 vars in 1177 bytes} [Sat Oct 1 20:32:41 2022] GET /identity/v3/users/81fdf771f81049ad98e41f1ea383514a => generated 297 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:41.447413 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78a479d-2c32-4bd2-9720-31532253a9ac None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:41.503197 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817bc784-2603-4f51-b15e-359a3a3db1d9 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:41.541009 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac6aed8-e2c5-4d75-b3bd-72fb8c26b2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:41.541724 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac6aed8-e2c5-4d75-b3bd-72fb8c26b2be None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:41.541996 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac6aed8-e2c5-4d75-b3bd-72fb8c26b2be None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:41.542267 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac6aed8-e2c5-4d75-b3bd-72fb8c26b2be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:41.542975 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac6aed8-e2c5-4d75-b3bd-72fb8c26b2be None admin] RBAC: Adding query filter params (role.id=593409d904954a0f8039eda5aa05fc40, user.id=c0a3f05f6e5849339c0dbb4b15c93ead, scope.system=all) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:32:41.543279 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac6aed8-e2c5-4d75-b3bd-72fb8c26b2be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:41.544977 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac6aed8-e2c5-4d75-b3bd-72fb8c26b2be None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:41.550456 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:41.552371 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 155/311] 10.222.0.23 () {56 vars in 1308 bytes} [Sat Oct 1 20:32:41 2022] GET /identity/v3/role_assignments?user.id=c0a3f05f6e5849339c0dbb4b15c93ead&scope.system=all&role.id=593409d904954a0f8039eda5aa05fc40 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:41.554727 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78a479d-2c32-4bd2-9720-31532253a9ac None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:41.558364 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac6aed8-e2c5-4d75-b3bd-72fb8c26b2be None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:41.595846 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea1909-6239-49a1-92f4-80803c5437fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:41.596452 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea1909-6239-49a1-92f4-80803c5437fa None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:41.596718 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea1909-6239-49a1-92f4-80803c5437fa None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:41.596988 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea1909-6239-49a1-92f4-80803c5437fa None admin] PATH_INFO: `/v3/roles/member` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:41.610170 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ea1909-6239-49a1-92f4-80803c5437fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 20:32:41.615424 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-c8ea1909-6239-49a1-92f4-80803c5437fa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 01 20:32:41.615424 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:32:41.615424 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:32:41.615424 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:32:41.615424 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:32:41.615424 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:32:41.615424 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:32:41.615424 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:32:41.615424 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:32:41.615424 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:32:41.615424 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:32:41.615424 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:32:41.615424 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 20:32:41.615424 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 20:32:41.615424 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 20:32:41.615424 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 20:32:41.616369 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 20:32:41.616369 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 20:32:41.616369 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 20:32:41.616369 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 20:32:41.616369 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:32:41.616369 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:32:41.616369 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:32:41.616369 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:32:41.616369 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:32:41.616369 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:32:41.616369 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:32:41.616369 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:32:41.616369 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:32:41.616369 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:32:41.616369 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:32:41.616369 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:32:41.618505 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:32:41.618505 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:32:41.618505 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:32:41.618505 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:32:41.618505 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 20:32:41.618505 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 20:32:41.618505 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 20:32:41.618505 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 20:32:41.618505 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 20:32:41.618505 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 20:32:41.618505 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 01 20:32:41.618505 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:32:41.618505 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 157/312] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Oct 1 20:32:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:32:41.622908 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea1909-6239-49a1-92f4-80803c5437fa None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:41.656200 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:41.695618 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac6aed8-e2c5-4d75-b3bd-72fb8c26b2be None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:41.745447 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f8c684-a0d6-4766-af5b-54248edf24f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:41.746077 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f8c684-a0d6-4766-af5b-54248edf24f2 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:41.746354 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f8c684-a0d6-4766-af5b-54248edf24f2 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:41.746635 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f8c684-a0d6-4766-af5b-54248edf24f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:41.751333 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea1909-6239-49a1-92f4-80803c5437fa None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:41.791943 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ec1568-ef34-43e1-8a8b-f79132a713ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:41.792898 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec1568-ef34-43e1-8a8b-f79132a713ed None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:41.793378 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec1568-ef34-43e1-8a8b-f79132a713ed None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:41.793820 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec1568-ef34-43e1-8a8b-f79132a713ed None admin] PATH_INFO: `/v3/roles` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:41.794729 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ec1568-ef34-43e1-8a8b-f79132a713ed None admin] RBAC: Adding query filter params (name=member) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:32:41.795209 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ec1568-ef34-43e1-8a8b-f79132a713ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:41.797869 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ec1568-ef34-43e1-8a8b-f79132a713ed None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:41.812584 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 158/313] 10.222.0.23 () {56 vars in 1101 bytes} [Sat Oct 1 20:32:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 20:32:41.813925 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ec1568-ef34-43e1-8a8b-f79132a713ed None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:41.820510 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f8c684-a0d6-4766-af5b-54248edf24f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:41.822093 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f8c684-a0d6-4766-af5b-54248edf24f2 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:41.840972 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:41.899229 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:41.931151 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ec1568-ef34-43e1-8a8b-f79132a713ed None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:41.939763 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 156/314] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Oct 1 20:32:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 01 20:32:41.940114 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f8c684-a0d6-4766-af5b-54248edf24f2 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:41.976881 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631e29a8-770e-4c20-b48e-d27b9512df48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:41.977972 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e29a8-770e-4c20-b48e-d27b9512df48 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:41.978505 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e29a8-770e-4c20-b48e-d27b9512df48 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:41.979003 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e29a8-770e-4c20-b48e-d27b9512df48 None admin] PATH_INFO: `/v3/users/eb73536d72f346c6bdf0d81af4681629` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:41.980347 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631e29a8-770e-4c20-b48e-d27b9512df48 None admin] RBAC: Authorizing `identity:get_user(user_id=eb73536d72f346c6bdf0d81af4681629)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:41.982059 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631e29a8-770e-4c20-b48e-d27b9512df48 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:41.984062 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 159/315] 10.222.0.23 () {56 vars in 1177 bytes} [Sat Oct 1 20:32:41 2022] GET /identity/v3/users/eb73536d72f346c6bdf0d81af4681629 => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:41.989693 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631e29a8-770e-4c20-b48e-d27b9512df48 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:42.050490 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f8c684-a0d6-4766-af5b-54248edf24f2 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:42.088968 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:42.091149 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad29b15-efdf-426b-84c4-0c135db40ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:42.091784 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad29b15-efdf-426b-84c4-0c135db40ad2 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:42.092068 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad29b15-efdf-426b-84c4-0c135db40ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:42.092443 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad29b15-efdf-426b-84c4-0c135db40ad2 None admin] PATH_INFO: `/v3/projects/4357ac4f8a434b11a19fefd8982470d2` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:42.094458 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad29b15-efdf-426b-84c4-0c135db40ad2 None admin] RBAC: Authorizing `identity:get_project(project_id=4357ac4f8a434b11a19fefd8982470d2)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:42.095949 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad29b15-efdf-426b-84c4-0c135db40ad2 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:42.103098 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 157/316] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Oct 1 20:32:41 2022] GET /identity/v3/projects/4357ac4f8a434b11a19fefd8982470d2 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:42.104104 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad29b15-efdf-426b-84c4-0c135db40ad2 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:42.115515 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631e29a8-770e-4c20-b48e-d27b9512df48 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:42.149979 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:42.155879 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec1bfac-5fad-4ca0-a608-32e8a35fb3d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:42.157211 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1bfac-5fad-4ca0-a608-32e8a35fb3d3 None admin] REQUEST_METHOD: `PUT` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:42.158231 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1bfac-5fad-4ca0-a608-32e8a35fb3d3 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:42.158897 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1bfac-5fad-4ca0-a608-32e8a35fb3d3 None admin] PATH_INFO: `/v3/system/users/eb73536d72f346c6bdf0d81af4681629/roles/82138515a02147ccb30f8d56863aab87` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:42.160630 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec1bfac-5fad-4ca0-a608-32e8a35fb3d3 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=eb73536d72f346c6bdf0d81af4681629, role_id=82138515a02147ccb30f8d56863aab87)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:42.162352 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec1bfac-5fad-4ca0-a608-32e8a35fb3d3 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:42.177087 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 160/317] 10.222.0.23 () {58 vars in 1334 bytes} [Sat Oct 1 20:32:41 2022] PUT /identity/v3/system/users/eb73536d72f346c6bdf0d81af4681629/roles/82138515a02147ccb30f8d56863aab87 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 20:32:42.219068 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad29b15-efdf-426b-84c4-0c135db40ad2 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:42.258750 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984b09c7-2774-46f2-ad11-26163ea4a512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:42.259286 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b09c7-2774-46f2-ad11-26163ea4a512 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:42.259566 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b09c7-2774-46f2-ad11-26163ea4a512 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:42.259840 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b09c7-2774-46f2-ad11-26163ea4a512 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:42.260600 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984b09c7-2774-46f2-ad11-26163ea4a512 None admin] RBAC: Adding query filter params (role.id=593409d904954a0f8039eda5aa05fc40, scope.project.id=4357ac4f8a434b11a19fefd8982470d2, user.id=81fdf771f81049ad98e41f1ea383514a) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:32:42.260913 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984b09c7-2774-46f2-ad11-26163ea4a512 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:42.262415 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984b09c7-2774-46f2-ad11-26163ea4a512 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:42.269778 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 158/318] 10.222.0.23 () {56 vars in 1374 bytes} [Sat Oct 1 20:32:42 2022] GET /identity/v3/role_assignments?user.id=81fdf771f81049ad98e41f1ea383514a&scope.project.id=4357ac4f8a434b11a19fefd8982470d2&role.id=593409d904954a0f8039eda5aa05fc40 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 20:32:43.685267 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d027088-286d-4f28-81e2-ddf0987787a6 None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:43.685797 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d027088-286d-4f28-81e2-ddf0987787a6 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:43.685797 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d027088-286d-4f28-81e2-ddf0987787a6 None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:43.688073 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 161/319] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:32:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:32:43.693452 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ba77c-e09c-42aa-80c5-ff2c18b5a605 None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:43.693883 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ba77c-e09c-42aa-80c5-ff2c18b5a605 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:43.694061 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ba77c-e09c-42aa-80c5-ff2c18b5a605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:43.713186 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-6b0ba77c-e09c-42aa-80c5-ff2c18b5a605 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:32:43.714371 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-6b0ba77c-e09c-42aa-80c5-ff2c18b5a605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:32:43.786303 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 159/320] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:32:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 20:32:44.026379 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094578a-ed35-43cd-97f2-fb97b5353e12 None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:44.026673 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094578a-ed35-43cd-97f2-fb97b5353e12 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:44.026941 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094578a-ed35-43cd-97f2-fb97b5353e12 None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:44.028260 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 162/321] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:32:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:32:44.033866 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ecdca0-9315-45cc-a8e0-231e7ccbf6d8 None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:44.034150 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ecdca0-9315-45cc-a8e0-231e7ccbf6d8 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:44.034573 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ecdca0-9315-45cc-a8e0-231e7ccbf6d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:44.052390 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-75ecdca0-9315-45cc-a8e0-231e7ccbf6d8 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:32:44.053587 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-75ecdca0-9315-45cc-a8e0-231e7ccbf6d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:32:44.081407 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:44.108345 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c094578a-ed35-43cd-97f2-fb97b5353e12 None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:44.128580 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 160/322] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:32:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 01 20:32:44.220596 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c094578a-ed35-43cd-97f2-fb97b5353e12 None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:44.258621 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359e951f-0ec7-46c5-b09a-ed1488a7493d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:44.259247 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e951f-0ec7-46c5-b09a-ed1488a7493d None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:44.259521 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e951f-0ec7-46c5-b09a-ed1488a7493d None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:44.259790 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e951f-0ec7-46c5-b09a-ed1488a7493d None admin] PATH_INFO: `/v3/domains/default` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:44.260967 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359e951f-0ec7-46c5-b09a-ed1488a7493d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:44.262394 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359e951f-0ec7-46c5-b09a-ed1488a7493d None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:44.264110 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 163/323] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Oct 1 20:32:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 20:32:44.269602 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ecdca0-9315-45cc-a8e0-231e7ccbf6d8 None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:44.372116 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ecdca0-9315-45cc-a8e0-231e7ccbf6d8 None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:44.406479 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022d2641-82bd-4634-b6d1-a46962b3188e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:44.407076 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d2641-82bd-4634-b6d1-a46962b3188e None admin] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:44.407352 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d2641-82bd-4634-b6d1-a46962b3188e None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:44.407620 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d2641-82bd-4634-b6d1-a46962b3188e None admin] PATH_INFO: `/v3/groups` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:44.408252 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022d2641-82bd-4634-b6d1-a46962b3188e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:44.409796 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022d2641-82bd-4634-b6d1-a46962b3188e None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:44.426480 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 161/324] 10.222.0.23 () {60 vars in 1134 bytes} [Sat Oct 1 20:32:44 2022] POST /identity/v3/groups => generated 226 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 20:32:44.445915 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359e951f-0ec7-46c5-b09a-ed1488a7493d None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:44.472639 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:44.562649 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359e951f-0ec7-46c5-b09a-ed1488a7493d None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:44.600404 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423400a2-22f2-494f-b903-d3d9dbc6aa09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:44.601070 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423400a2-22f2-494f-b903-d3d9dbc6aa09 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:44.601398 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423400a2-22f2-494f-b903-d3d9dbc6aa09 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:44.601668 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423400a2-22f2-494f-b903-d3d9dbc6aa09 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:44.613500 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423400a2-22f2-494f-b903-d3d9dbc6aa09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 20:32:44.619050 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-423400a2-22f2-494f-b903-d3d9dbc6aa09 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 01 20:32:44.619050 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:32:44.619050 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:32:44.619050 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:32:44.619050 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:32:44.619050 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:32:44.619050 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:32:44.619050 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:32:44.619050 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:32:44.619050 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:32:44.619050 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:32:44.619050 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:32:44.619050 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 20:32:44.619050 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 20:32:44.619050 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 20:32:44.619050 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 20:32:44.620028 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 20:32:44.620028 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 20:32:44.620028 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 20:32:44.620028 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 20:32:44.620028 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:32:44.620028 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:32:44.620028 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:32:44.620028 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:32:44.620028 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:32:44.620028 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:32:44.620028 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:32:44.620028 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:32:44.620028 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:32:44.620028 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:32:44.620028 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:32:44.620028 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:32:44.627031 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:32:44.627031 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:32:44.627031 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:32:44.627031 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:32:44.627031 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 20:32:44.627031 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 20:32:44.627031 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 20:32:44.627031 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 20:32:44.627031 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 20:32:44.627031 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 20:32:44.627031 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 01 20:32:44.627031 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:32:44.627031 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 164/325] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Oct 1 20:32:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:32:44.630124 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022d2641-82bd-4634-b6d1-a46962b3188e None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:44.653011 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd0fb3-6284-43a3-bf87-114f28d7242f None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:44.653315 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd0fb3-6284-43a3-bf87-114f28d7242f None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:44.653550 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd0fb3-6284-43a3-bf87-114f28d7242f None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:44.655107 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 165/326] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:32:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 01 20:32:44.658896 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:44.660618 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1394176-e907-4ad6-89d5-84f17ab06b76 None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:44.660962 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1394176-e907-4ad6-89d5-84f17ab06b76 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:44.661222 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1394176-e907-4ad6-89d5-84f17ab06b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:44.679582 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-b1394176-e907-4ad6-89d5-84f17ab06b76 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:32:44.680800 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-b1394176-e907-4ad6-89d5-84f17ab06b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:32:44.750318 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022d2641-82bd-4634-b6d1-a46962b3188e None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:44.769743 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 166/327] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:32:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 01 20:32:44.796581 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa318e6-025d-4519-a73c-ad4d9f159932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:44.797278 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa318e6-025d-4519-a73c-ad4d9f159932 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:44.797554 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa318e6-025d-4519-a73c-ad4d9f159932 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:44.797829 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa318e6-025d-4519-a73c-ad4d9f159932 None admin] PATH_INFO: `/v3/roles` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:44.798501 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa318e6-025d-4519-a73c-ad4d9f159932 None admin] RBAC: Adding query filter params (name=reader) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:32:44.798799 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa318e6-025d-4519-a73c-ad4d9f159932 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:44.800175 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa318e6-025d-4519-a73c-ad4d9f159932 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:44.809829 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 162/328] 10.222.0.23 () {56 vars in 1101 bytes} [Sat Oct 1 20:32:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:44.815993 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1394176-e907-4ad6-89d5-84f17ab06b76 None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:44.828816 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:44.923210 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1394176-e907-4ad6-89d5-84f17ab06b76 None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:44.959581 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f3c0f7-779a-4f72-ae7a-a2f92c3f534c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:44.960222 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f3c0f7-779a-4f72-ae7a-a2f92c3f534c None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:44.960495 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f3c0f7-779a-4f72-ae7a-a2f92c3f534c None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:44.960808 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f3c0f7-779a-4f72-ae7a-a2f92c3f534c None admin] PATH_INFO: `/v3/users/c0a3f05f6e5849339c0dbb4b15c93ead` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:44.961924 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f3c0f7-779a-4f72-ae7a-a2f92c3f534c None admin] RBAC: Authorizing `identity:get_user(user_id=c0a3f05f6e5849339c0dbb4b15c93ead)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:44.963374 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f3c0f7-779a-4f72-ae7a-a2f92c3f534c None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:44.965441 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 167/329] 10.222.0.23 () {56 vars in 1177 bytes} [Sat Oct 1 20:32:44 2022] GET /identity/v3/users/c0a3f05f6e5849339c0dbb4b15c93ead => generated 293 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:44.971670 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa318e6-025d-4519-a73c-ad4d9f159932 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:45.066835 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:45.083226 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa318e6-025d-4519-a73c-ad4d9f159932 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:45.119846 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59813895-e389-496a-9e06-008b55ebb517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:45.120498 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59813895-e389-496a-9e06-008b55ebb517 None admin] REQUEST_METHOD: `PUT` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:45.120803 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59813895-e389-496a-9e06-008b55ebb517 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:45.121076 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59813895-e389-496a-9e06-008b55ebb517 None admin] PATH_INFO: `/v3/system/users/c0a3f05f6e5849339c0dbb4b15c93ead/roles/593409d904954a0f8039eda5aa05fc40` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:45.122496 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59813895-e389-496a-9e06-008b55ebb517 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c0a3f05f6e5849339c0dbb4b15c93ead, role_id=593409d904954a0f8039eda5aa05fc40)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:45.123882 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59813895-e389-496a-9e06-008b55ebb517 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:45.135502 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 163/330] 10.222.0.23 () {58 vars in 1334 bytes} [Sat Oct 1 20:32:44 2022] PUT /identity/v3/system/users/c0a3f05f6e5849339c0dbb4b15c93ead/roles/593409d904954a0f8039eda5aa05fc40 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 20:32:45.161188 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f3c0f7-779a-4f72-ae7a-a2f92c3f534c None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:45.256663 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:45.285438 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f3c0f7-779a-4f72-ae7a-a2f92c3f534c None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:45.324655 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d713ac13-f02e-4dce-81e0-c770fa5ea9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:45.325707 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d713ac13-f02e-4dce-81e0-c770fa5ea9aa None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:45.326199 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d713ac13-f02e-4dce-81e0-c770fa5ea9aa None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:45.326683 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d713ac13-f02e-4dce-81e0-c770fa5ea9aa None admin] PATH_INFO: `/v3/roles/member` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:45.339631 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d713ac13-f02e-4dce-81e0-c770fa5ea9aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 20:32:45.352484 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-d713ac13-f02e-4dce-81e0-c770fa5ea9aa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 01 20:32:45.352484 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:32:45.352484 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:32:45.352484 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:32:45.352484 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:32:45.352484 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:32:45.352484 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:32:45.352484 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:32:45.352484 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:32:45.352484 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:32:45.352484 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:32:45.352484 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:32:45.352484 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 20:32:45.352484 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 20:32:45.352484 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 20:32:45.352484 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 20:32:45.353467 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 20:32:45.353467 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 20:32:45.353467 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 20:32:45.353467 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 20:32:45.353467 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:32:45.353467 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:32:45.353467 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:32:45.353467 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:32:45.353467 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:32:45.353467 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:32:45.353467 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:32:45.353467 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:32:45.353467 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:32:45.353467 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:32:45.353467 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:32:45.353467 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:32:45.354386 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:32:45.354386 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:32:45.354386 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:32:45.354386 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:32:45.354386 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 20:32:45.354386 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 20:32:45.354386 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 20:32:45.354386 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 20:32:45.354386 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 20:32:45.354386 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 20:32:45.354386 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 01 20:32:45.354386 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:32:45.357074 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 168/331] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Oct 1 20:32:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:32:45.363710 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59813895-e389-496a-9e06-008b55ebb517 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:45.495148 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59813895-e389-496a-9e06-008b55ebb517 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:45.542645 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2061410f-b770-4253-ac8a-54a098751374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:45.543256 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2061410f-b770-4253-ac8a-54a098751374 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:45.543532 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2061410f-b770-4253-ac8a-54a098751374 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:45.543803 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2061410f-b770-4253-ac8a-54a098751374 None admin] PATH_INFO: `/v3/roles` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:45.544461 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2061410f-b770-4253-ac8a-54a098751374 None admin] RBAC: Adding query filter params (name=member) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:32:45.544785 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2061410f-b770-4253-ac8a-54a098751374 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:45.546240 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2061410f-b770-4253-ac8a-54a098751374 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:45.560132 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 164/332] 10.222.0.23 () {56 vars in 1101 bytes} [Sat Oct 1 20:32:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:45.566491 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d713ac13-f02e-4dce-81e0-c770fa5ea9aa None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:45.701286 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d713ac13-f02e-4dce-81e0-c770fa5ea9aa None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:45.746715 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35bec61-e574-40f1-a98b-77c296897637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:45.747724 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35bec61-e574-40f1-a98b-77c296897637 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:45.748211 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35bec61-e574-40f1-a98b-77c296897637 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:45.748711 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35bec61-e574-40f1-a98b-77c296897637 None admin] PATH_INFO: `/v3/users/eb73536d72f346c6bdf0d81af4681629` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:45.750173 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35bec61-e574-40f1-a98b-77c296897637 None admin] RBAC: Authorizing `identity:get_user(user_id=eb73536d72f346c6bdf0d81af4681629)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:45.751650 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35bec61-e574-40f1-a98b-77c296897637 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:45.753471 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 169/333] 10.222.0.23 () {56 vars in 1177 bytes} [Sat Oct 1 20:32:45 2022] GET /identity/v3/users/eb73536d72f346c6bdf0d81af4681629 => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:45.759243 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2061410f-b770-4253-ac8a-54a098751374 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:45.786340 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:45.895832 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2061410f-b770-4253-ac8a-54a098751374 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:45.935618 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24410529-8f25-469b-a617-63282068d3bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:45.936221 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24410529-8f25-469b-a617-63282068d3bd None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:45.936494 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24410529-8f25-469b-a617-63282068d3bd None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:45.936841 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24410529-8f25-469b-a617-63282068d3bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:45.937562 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24410529-8f25-469b-a617-63282068d3bd None admin] RBAC: Adding query filter params (role.id=82138515a02147ccb30f8d56863aab87, user.id=eb73536d72f346c6bdf0d81af4681629, scope.system=all) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:32:45.937865 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24410529-8f25-469b-a617-63282068d3bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:45.939313 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24410529-8f25-469b-a617-63282068d3bd None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:45.955604 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 165/334] 10.222.0.23 () {56 vars in 1308 bytes} [Sat Oct 1 20:32:45 2022] GET /identity/v3/role_assignments?user.id=eb73536d72f346c6bdf0d81af4681629&scope.system=all&role.id=82138515a02147ccb30f8d56863aab87 => generated 510 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:47.806188 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f6148-a33c-4071-af69-ece8273ecf7d None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:47.806704 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f6148-a33c-4071-af69-ece8273ecf7d None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:47.806780 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f6148-a33c-4071-af69-ece8273ecf7d None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:47.808378 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 170/335] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:32:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:32:47.813948 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f74f361-cb27-4f6d-8afb-6f9fb8f3d3a5 None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:47.814404 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f74f361-cb27-4f6d-8afb-6f9fb8f3d3a5 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:47.814480 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f74f361-cb27-4f6d-8afb-6f9fb8f3d3a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:47.838861 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-8f74f361-cb27-4f6d-8afb-6f9fb8f3d3a5 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:32:47.840239 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-8f74f361-cb27-4f6d-8afb-6f9fb8f3d3a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:32:47.890983 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277193d1-0723-49c6-8655-18eb1205e5b3 None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:47.891340 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277193d1-0723-49c6-8655-18eb1205e5b3 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:47.891514 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277193d1-0723-49c6-8655-18eb1205e5b3 None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:47.892877 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 171/336] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:32:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:32:47.906910 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6632d2af-b753-46c0-abaa-cea495f09728 None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:47.907229 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6632d2af-b753-46c0-abaa-cea495f09728 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:47.907460 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6632d2af-b753-46c0-abaa-cea495f09728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:47.928503 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:47.929460 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:47.938862 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 166/337] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:32:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 20:32:47.939820 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-6632d2af-b753-46c0-abaa-cea495f09728 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:32:47.941053 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-6632d2af-b753-46c0-abaa-cea495f09728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:32:48.090834 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 172/338] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:32:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 20:32:48.378890 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f74f361-cb27-4f6d-8afb-6f9fb8f3d3a5 None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:48.513645 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f74f361-cb27-4f6d-8afb-6f9fb8f3d3a5 None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:48.558722 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79710b3-1f33-4793-8938-f9bb0266441b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:48.559749 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79710b3-1f33-4793-8938-f9bb0266441b None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:48.560241 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79710b3-1f33-4793-8938-f9bb0266441b None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:48.560891 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79710b3-1f33-4793-8938-f9bb0266441b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:48.582796 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79710b3-1f33-4793-8938-f9bb0266441b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 20:32:48.588258 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application [None req-a79710b3-1f33-4793-8938-f9bb0266441b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 01 20:32:48.588258 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:32:48.588258 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:32:48.588258 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:32:48.588258 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:32:48.588258 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:32:48.588258 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:32:48.588258 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:32:48.588258 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:32:48.588258 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:32:48.588258 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:32:48.588258 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:32:48.588258 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 20:32:48.588258 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 20:32:48.588258 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 20:32:48.588258 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 20:32:48.589324 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 20:32:48.589324 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 20:32:48.589324 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 20:32:48.589324 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 20:32:48.589324 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:32:48.589324 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:32:48.589324 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:32:48.589324 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:32:48.589324 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:32:48.589324 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:32:48.589324 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:32:48.589324 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application with Lock( Oct 01 20:32:48.589324 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:32:48.589324 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:32:48.589324 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:32:48.589324 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:32:48.590292 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:32:48.590292 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:32:48.590292 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:32:48.590292 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:32:48.590292 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 20:32:48.590292 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 20:32:48.590292 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 20:32:48.590292 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 20:32:48.590292 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 20:32:48.590292 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 20:32:48.590292 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 01 20:32:48.590292 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:32:48.592195 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 167/339] 10.222.0.23 () {56 vars in 1114 bytes} [Sat Oct 1 20:32:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:32:48.599548 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6632d2af-b753-46c0-abaa-cea495f09728 None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:48.728550 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6632d2af-b753-46c0-abaa-cea495f09728 None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:48.743432 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433b27a-ced3-40f0-8e27-739187d6bae2 None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:48.743968 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433b27a-ced3-40f0-8e27-739187d6bae2 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:48.744399 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433b27a-ced3-40f0-8e27-739187d6bae2 None None] PATH_INFO: `/` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:48.746149 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 168/340] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:32:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:32:48.761996 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf7d375-cb55-49be-be6e-a58512ba2a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:48.762667 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf7d375-cb55-49be-be6e-a58512ba2a69 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:48.762896 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf7d375-cb55-49be-be6e-a58512ba2a69 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:48.763142 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf7d375-cb55-49be-be6e-a58512ba2a69 None admin] PATH_INFO: `/v3/roles` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:48.763799 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf7d375-cb55-49be-be6e-a58512ba2a69 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:32:48.764097 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf7d375-cb55-49be-be6e-a58512ba2a69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:48.766103 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf7d375-cb55-49be-be6e-a58512ba2a69 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:48.766513 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd8b355-ccfa-497d-a9a4-ecbad36ca490 None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:48.767003 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd8b355-ccfa-497d-a9a4-ecbad36ca490 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:48.767467 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd8b355-ccfa-497d-a9a4-ecbad36ca490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:48.768658 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:48.777395 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 173/341] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Oct 1 20:32:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:48.798746 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf7d375-cb55-49be-be6e-a58512ba2a69 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:48.799945 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-5dd8b355-ccfa-497d-a9a4-ecbad36ca490 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:32:48.801353 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-5dd8b355-ccfa-497d-a9a4-ecbad36ca490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:32:48.914630 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf7d375-cb55-49be-be6e-a58512ba2a69 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:48.915287 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:48.955470 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 169/342] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:32:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 20:32:48.956319 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adfbf84-a010-4ddd-a71c-3e916f99bb0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:48.956470 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd8b355-ccfa-497d-a9a4-ecbad36ca490 None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:48.956999 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adfbf84-a010-4ddd-a71c-3e916f99bb0c None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:48.957272 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adfbf84-a010-4ddd-a71c-3e916f99bb0c None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:48.957533 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adfbf84-a010-4ddd-a71c-3e916f99bb0c None admin] PATH_INFO: `/v3/roles/member` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:48.970264 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adfbf84-a010-4ddd-a71c-3e916f99bb0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 20:32:48.975580 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-1adfbf84-a010-4ddd-a71c-3e916f99bb0c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 01 20:32:48.975580 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:32:48.975580 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:32:48.975580 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:32:48.975580 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:32:48.975580 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:32:48.975580 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:32:48.975580 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:32:48.975580 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:32:48.975580 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:32:48.975580 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:32:48.975580 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:32:48.975580 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 20:32:48.975580 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 20:32:48.975580 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 20:32:48.975580 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 20:32:48.976464 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 20:32:48.976464 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 20:32:48.976464 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 20:32:48.976464 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 20:32:48.976464 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:32:48.976464 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:32:48.976464 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:32:48.976464 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:32:48.976464 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:32:48.976464 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:32:48.976464 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:32:48.976464 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:32:48.976464 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:32:48.976464 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:32:48.976464 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:32:48.976464 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:32:48.977292 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:32:48.977292 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:32:48.977292 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:32:48.977292 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:32:48.977292 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 20:32:48.977292 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 20:32:48.977292 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 20:32:48.977292 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 20:32:48.977292 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 20:32:48.977292 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 20:32:48.977292 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 01 20:32:48.977292 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:32:48.977292 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 174/343] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Oct 1 20:32:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 01 20:32:48.982522 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adfbf84-a010-4ddd-a71c-3e916f99bb0c None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:49.048744 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:49.094071 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adfbf84-a010-4ddd-a71c-3e916f99bb0c None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:49.131354 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd806ce-08dd-43ad-89ca-b610b8771c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:49.131970 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd806ce-08dd-43ad-89ca-b610b8771c6d None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:49.132246 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd806ce-08dd-43ad-89ca-b610b8771c6d None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:49.132516 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd806ce-08dd-43ad-89ca-b610b8771c6d None admin] PATH_INFO: `/v3/roles` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:49.133209 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd806ce-08dd-43ad-89ca-b610b8771c6d None admin] RBAC: Adding query filter params (name=member) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:32:49.133514 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd806ce-08dd-43ad-89ca-b610b8771c6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:49.135014 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd806ce-08dd-43ad-89ca-b610b8771c6d None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:49.144104 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 175/344] 10.222.0.23 () {56 vars in 1101 bytes} [Sat Oct 1 20:32:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 20:32:49.150272 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd806ce-08dd-43ad-89ca-b610b8771c6d None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:49.198749 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd8b355-ccfa-497d-a9a4-ecbad36ca490 None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:49.261604 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd806ce-08dd-43ad-89ca-b610b8771c6d None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:49.270234 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cefb83-cf33-4ee7-bd32-a6536caa1c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:49.270870 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cefb83-cf33-4ee7-bd32-a6536caa1c79 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:49.271155 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cefb83-cf33-4ee7-bd32-a6536caa1c79 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:49.271420 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cefb83-cf33-4ee7-bd32-a6536caa1c79 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:49.284924 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:49.298261 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8c7331-ad2f-4bed-b90a-c4b9edfad4ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:49.298869 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c7331-ad2f-4bed-b90a-c4b9edfad4ef None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:49.299432 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c7331-ad2f-4bed-b90a-c4b9edfad4ef None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:49.299707 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c7331-ad2f-4bed-b90a-c4b9edfad4ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:49.376598 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8c7331-ad2f-4bed-b90a-c4b9edfad4ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:49.378767 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8c7331-ad2f-4bed-b90a-c4b9edfad4ef None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:49.385911 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:49.414796 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cefb83-cf33-4ee7-bd32-a6536caa1c79 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:49.416290 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cefb83-cf33-4ee7-bd32-a6536caa1c79 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:49.487701 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 176/345] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Oct 1 20:32:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 01 20:32:49.491001 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b69b7-f88c-42ca-b548-2bb414f3a2d3 None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:49.491296 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b69b7-f88c-42ca-b548-2bb414f3a2d3 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:49.491570 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b69b7-f88c-42ca-b548-2bb414f3a2d3 None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:49.492973 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 177/346] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:32:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:32:49.494057 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3531b124-a92d-4bc4-87eb-8284300c2b13 None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:49.494331 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3531b124-a92d-4bc4-87eb-8284300c2b13 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:49.494596 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3531b124-a92d-4bc4-87eb-8284300c2b13 None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:49.495871 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 178/347] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:32:49 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:32:49.499338 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3531b124-a92d-4bc4-87eb-8284300c2b13 None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:49.531206 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:49.574409 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 170/348] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Oct 1 20:32:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 618 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 01 20:32:49.576569 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e9a390-dc04-4af9-a555-b4c7a4e4181f None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:49.581546 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e9a390-dc04-4af9-a555-b4c7a4e4181f None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:49.581831 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e9a390-dc04-4af9-a555-b4c7a4e4181f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:49.600485 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-88e9a390-dc04-4af9-a555-b4c7a4e4181f None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:32:49.601694 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-88e9a390-dc04-4af9-a555-b4c7a4e4181f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:32:49.626947 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3531b124-a92d-4bc4-87eb-8284300c2b13 None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:49.672864 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbb7a41-be75-4f1c-ba20-5f4b93559ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:49.673540 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbb7a41-be75-4f1c-ba20-5f4b93559ef7 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:49.673822 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbb7a41-be75-4f1c-ba20-5f4b93559ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:49.674094 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbb7a41-be75-4f1c-ba20-5f4b93559ef7 None admin] PATH_INFO: `/v3/projects/754d04e2573f4c81b21775be5d8d103e` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:49.675244 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbb7a41-be75-4f1c-ba20-5f4b93559ef7 None admin] RBAC: Authorizing `identity:get_project(project_id=754d04e2573f4c81b21775be5d8d103e)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:49.676739 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbb7a41-be75-4f1c-ba20-5f4b93559ef7 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:49.677905 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 171/349] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:32:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 20:32:49.678381 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 179/350] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Oct 1 20:32:49 2022] GET /identity/v3/projects/754d04e2573f4c81b21775be5d8d103e => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:49.679125 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbb7a41-be75-4f1c-ba20-5f4b93559ef7 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:49.683987 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23015cc7-7adf-4845-836c-2be7b8a53855 None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:49.684277 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23015cc7-7adf-4845-836c-2be7b8a53855 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:49.684564 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23015cc7-7adf-4845-836c-2be7b8a53855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:49.703795 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-23015cc7-7adf-4845-836c-2be7b8a53855 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:32:49.705298 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-23015cc7-7adf-4845-836c-2be7b8a53855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:32:49.726740 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:49.790192 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:49.794707 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 172/351] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:32:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 20:32:49.795725 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23015cc7-7adf-4845-836c-2be7b8a53855 None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:49.802806 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbb7a41-be75-4f1c-ba20-5f4b93559ef7 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:49.840471 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abf2219-85a4-41b0-964a-8d02d16b95e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:49.841552 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf2219-85a4-41b0-964a-8d02d16b95e6 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:49.842026 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf2219-85a4-41b0-964a-8d02d16b95e6 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:49.842521 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf2219-85a4-41b0-964a-8d02d16b95e6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:49.854509 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abf2219-85a4-41b0-964a-8d02d16b95e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 20:32:49.860782 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-6abf2219-85a4-41b0-964a-8d02d16b95e6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 01 20:32:49.860782 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:32:49.860782 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:32:49.860782 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:32:49.860782 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:32:49.860782 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:32:49.860782 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:32:49.860782 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:32:49.860782 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:32:49.860782 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:32:49.860782 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:32:49.860782 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:32:49.860782 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 20:32:49.860782 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 20:32:49.860782 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 20:32:49.860782 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 20:32:49.861668 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 20:32:49.861668 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 20:32:49.861668 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 20:32:49.861668 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 20:32:49.861668 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:32:49.861668 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:32:49.861668 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:32:49.861668 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:32:49.861668 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:32:49.861668 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:32:49.861668 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:32:49.861668 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:32:49.861668 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:32:49.861668 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:32:49.861668 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:32:49.861668 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:32:49.862489 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:32:49.862489 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:32:49.862489 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:32:49.862489 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:32:49.862489 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 20:32:49.862489 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 20:32:49.862489 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 20:32:49.862489 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 20:32:49.862489 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 20:32:49.862489 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 20:32:49.862489 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 01 20:32:49.862489 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:32:49.864813 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 180/352] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Oct 1 20:32:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:32:49.865857 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abf2219-85a4-41b0-964a-8d02d16b95e6 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:49.981693 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abf2219-85a4-41b0-964a-8d02d16b95e6 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:50.021200 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e191599-33f4-4a68-94e3-2fc6ad2d9188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:50.021833 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e191599-33f4-4a68-94e3-2fc6ad2d9188 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:50.022110 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e191599-33f4-4a68-94e3-2fc6ad2d9188 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:50.022378 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e191599-33f4-4a68-94e3-2fc6ad2d9188 None admin] PATH_INFO: `/v3/groups/0c478203200b4ad29d0e6cb8e8f028b7` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:50.024070 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23015cc7-7adf-4845-836c-2be7b8a53855 None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:50.028857 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e191599-33f4-4a68-94e3-2fc6ad2d9188 None admin] RBAC: Authorizing `identity:get_group(group_id=0c478203200b4ad29d0e6cb8e8f028b7)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:50.032148 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e191599-33f4-4a68-94e3-2fc6ad2d9188 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:50.034202 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 181/353] 10.222.0.23 () {56 vars in 1180 bytes} [Sat Oct 1 20:32:49 2022] GET /identity/v3/groups/0c478203200b4ad29d0e6cb8e8f028b7 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:50.035404 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e191599-33f4-4a68-94e3-2fc6ad2d9188 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:50.057377 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:50.086409 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e472f7-5e3f-4480-8b31-9ae44ffd8a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:50.087054 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e472f7-5e3f-4480-8b31-9ae44ffd8a24 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:50.087334 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e472f7-5e3f-4480-8b31-9ae44ffd8a24 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:50.087609 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e472f7-5e3f-4480-8b31-9ae44ffd8a24 None admin] PATH_INFO: `/v3/projects/754d04e2573f4c81b21775be5d8d103e` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:50.090874 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e472f7-5e3f-4480-8b31-9ae44ffd8a24 None admin] RBAC: Authorizing `identity:get_project(project_id=754d04e2573f4c81b21775be5d8d103e)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:50.093639 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e472f7-5e3f-4480-8b31-9ae44ffd8a24 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:50.096405 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 173/354] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Oct 1 20:32:49 2022] GET /identity/v3/projects/754d04e2573f4c81b21775be5d8d103e => generated 298 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:50.097420 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e472f7-5e3f-4480-8b31-9ae44ffd8a24 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:50.122093 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:50.166671 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e191599-33f4-4a68-94e3-2fc6ad2d9188 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:50.222963 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60824f2-fcf7-45c9-b856-687198f13906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:50.223678 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60824f2-fcf7-45c9-b856-687198f13906 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:50.225851 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60824f2-fcf7-45c9-b856-687198f13906 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:50.226148 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60824f2-fcf7-45c9-b856-687198f13906 None admin] PATH_INFO: `/v3/roles` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:50.226842 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60824f2-fcf7-45c9-b856-687198f13906 None admin] RBAC: Adding query filter params (name=reader) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:32:50.227142 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60824f2-fcf7-45c9-b856-687198f13906 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:50.228609 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60824f2-fcf7-45c9-b856-687198f13906 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:50.241541 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 182/355] 10.222.0.23 () {56 vars in 1101 bytes} [Sat Oct 1 20:32:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:50.243145 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60824f2-fcf7-45c9-b856-687198f13906 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:50.245598 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e472f7-5e3f-4480-8b31-9ae44ffd8a24 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:50.289970 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e215897f-0cd7-459e-8076-6ee9b00ebc9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:50.290872 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e215897f-0cd7-459e-8076-6ee9b00ebc9d None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:50.291360 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e215897f-0cd7-459e-8076-6ee9b00ebc9d None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:50.291634 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e215897f-0cd7-459e-8076-6ee9b00ebc9d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:50.292357 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e215897f-0cd7-459e-8076-6ee9b00ebc9d None admin] RBAC: Adding query filter params (group.id=0c478203200b4ad29d0e6cb8e8f028b7, role.id=82138515a02147ccb30f8d56863aab87, scope.project.id=754d04e2573f4c81b21775be5d8d103e) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:32:50.292716 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e215897f-0cd7-459e-8076-6ee9b00ebc9d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:50.294152 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e215897f-0cd7-459e-8076-6ee9b00ebc9d None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:50.308768 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 174/356] 10.222.0.23 () {56 vars in 1376 bytes} [Sat Oct 1 20:32:50 2022] GET /identity/v3/role_assignments?group.id=0c478203200b4ad29d0e6cb8e8f028b7&scope.project.id=754d04e2573f4c81b21775be5d8d103e&role.id=82138515a02147ccb30f8d56863aab87 => generated 260 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:50.308768 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e215897f-0cd7-459e-8076-6ee9b00ebc9d None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:50.362307 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:50.404977 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60824f2-fcf7-45c9-b856-687198f13906 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:50.430840 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:50.449779 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fd4877-e806-4a56-92d1-113c99db5350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:50.450429 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd4877-e806-4a56-92d1-113c99db5350 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:50.450704 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd4877-e806-4a56-92d1-113c99db5350 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:50.451091 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd4877-e806-4a56-92d1-113c99db5350 None admin] PATH_INFO: `/v3/roles/member` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:50.458389 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e215897f-0cd7-459e-8076-6ee9b00ebc9d None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:50.465061 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fd4877-e806-4a56-92d1-113c99db5350 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 20:32:50.471577 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-d8fd4877-e806-4a56-92d1-113c99db5350 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 01 20:32:50.471577 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:32:50.471577 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:32:50.471577 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:32:50.471577 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:32:50.471577 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:32:50.471577 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:32:50.471577 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:32:50.471577 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:32:50.471577 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:32:50.471577 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:32:50.471577 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:32:50.471577 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 20:32:50.471577 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 20:32:50.471577 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 20:32:50.471577 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 20:32:50.472551 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 20:32:50.472551 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 20:32:50.472551 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 20:32:50.472551 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 20:32:50.472551 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:32:50.472551 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:32:50.472551 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:32:50.472551 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:32:50.472551 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:32:50.472551 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:32:50.472551 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:32:50.472551 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:32:50.472551 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:32:50.472551 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:32:50.472551 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:32:50.472551 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:32:50.473401 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:32:50.473401 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:32:50.473401 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:32:50.473401 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:32:50.473401 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 20:32:50.473401 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 20:32:50.473401 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 20:32:50.473401 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 20:32:50.473401 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 20:32:50.473401 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 20:32:50.473401 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 01 20:32:50.473401 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:32:50.473401 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 183/357] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Oct 1 20:32:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:32:50.474064 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fd4877-e806-4a56-92d1-113c99db5350 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:50.503351 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d64667-c753-49ca-a3de-55cb06d22c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:50.505012 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d64667-c753-49ca-a3de-55cb06d22c43 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:50.505507 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d64667-c753-49ca-a3de-55cb06d22c43 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:50.505986 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d64667-c753-49ca-a3de-55cb06d22c43 None admin] PATH_INFO: `/v3/groups/0c478203200b4ad29d0e6cb8e8f028b7` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:50.507617 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d64667-c753-49ca-a3de-55cb06d22c43 None admin] RBAC: Authorizing `identity:get_group(group_id=0c478203200b4ad29d0e6cb8e8f028b7)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:50.509843 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d64667-c753-49ca-a3de-55cb06d22c43 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:50.513075 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 175/358] 10.222.0.23 () {56 vars in 1180 bytes} [Sat Oct 1 20:32:50 2022] GET /identity/v3/groups/0c478203200b4ad29d0e6cb8e8f028b7 => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:50.514421 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d64667-c753-49ca-a3de-55cb06d22c43 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:50.627502 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fd4877-e806-4a56-92d1-113c99db5350 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:50.663906 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d64667-c753-49ca-a3de-55cb06d22c43 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:50.670369 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aed933-6ac8-4041-b0b0-46ba967bec7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:50.671588 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aed933-6ac8-4041-b0b0-46ba967bec7e None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:50.671904 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aed933-6ac8-4041-b0b0-46ba967bec7e None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:50.672136 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aed933-6ac8-4041-b0b0-46ba967bec7e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:50.680882 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:50.686920 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aed933-6ac8-4041-b0b0-46ba967bec7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 20:32:50.694867 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-99aed933-6ac8-4041-b0b0-46ba967bec7e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 01 20:32:50.694867 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:32:50.694867 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:32:50.694867 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:32:50.694867 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:32:50.694867 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:32:50.694867 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:32:50.694867 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:32:50.694867 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:32:50.694867 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:32:50.694867 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:32:50.694867 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:32:50.694867 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 20:32:50.694867 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 20:32:50.694867 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 20:32:50.694867 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 20:32:50.695872 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 20:32:50.695872 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 20:32:50.695872 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 20:32:50.695872 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 20:32:50.695872 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:32:50.695872 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:32:50.695872 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:32:50.695872 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:32:50.695872 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:32:50.695872 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:32:50.695872 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:32:50.695872 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:32:50.695872 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:32:50.695872 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:32:50.695872 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:32:50.695872 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:32:50.696835 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:32:50.696835 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:32:50.696835 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:32:50.696835 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:32:50.696835 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 20:32:50.696835 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 20:32:50.696835 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 20:32:50.696835 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 20:32:50.696835 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 20:32:50.696835 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 20:32:50.696835 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 01 20:32:50.696835 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:32:50.699374 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 184/359] 10.222.0.23 () {56 vars in 1114 bytes} [Sat Oct 1 20:32:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:32:50.700414 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aed933-6ac8-4041-b0b0-46ba967bec7e None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:50.705160 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1614b3e5-423f-4dda-b9ed-ce77bc213e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:50.706742 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614b3e5-423f-4dda-b9ed-ce77bc213e5f None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:50.707037 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614b3e5-423f-4dda-b9ed-ce77bc213e5f None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:50.707382 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614b3e5-423f-4dda-b9ed-ce77bc213e5f None admin] PATH_INFO: `/v3/users/c0a3f05f6e5849339c0dbb4b15c93ead` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:50.708468 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1614b3e5-423f-4dda-b9ed-ce77bc213e5f None admin] RBAC: Authorizing `identity:get_user(user_id=c0a3f05f6e5849339c0dbb4b15c93ead)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:50.710011 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1614b3e5-423f-4dda-b9ed-ce77bc213e5f None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:50.711872 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 176/360] 10.222.0.23 () {56 vars in 1177 bytes} [Sat Oct 1 20:32:50 2022] GET /identity/v3/users/c0a3f05f6e5849339c0dbb4b15c93ead => generated 293 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:50.712667 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1614b3e5-423f-4dda-b9ed-ce77bc213e5f None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:50.741671 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:50.840338 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aed933-6ac8-4041-b0b0-46ba967bec7e None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:50.855499 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1614b3e5-423f-4dda-b9ed-ce77bc213e5f None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:50.886749 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7990849-6665-46e3-8e8e-45224f5bd6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:50.887153 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7990849-6665-46e3-8e8e-45224f5bd6ee None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:50.887434 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7990849-6665-46e3-8e8e-45224f5bd6ee None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:50.887702 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7990849-6665-46e3-8e8e-45224f5bd6ee None admin] PATH_INFO: `/v3/roles` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:50.888368 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7990849-6665-46e3-8e8e-45224f5bd6ee None admin] RBAC: Adding query filter params (name=member) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:32:50.888740 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7990849-6665-46e3-8e8e-45224f5bd6ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:50.891329 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7990849-6665-46e3-8e8e-45224f5bd6ee None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:50.897690 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a7786f-8622-4c41-860e-14a02a51353e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:50.898125 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a7786f-8622-4c41-860e-14a02a51353e None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:50.898539 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a7786f-8622-4c41-860e-14a02a51353e None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:50.898820 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a7786f-8622-4c41-860e-14a02a51353e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:50.899537 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a7786f-8622-4c41-860e-14a02a51353e None admin] RBAC: Adding query filter params (group.id=0c478203200b4ad29d0e6cb8e8f028b7, role.id=8789e127ff4549b4883a92a87573ad3e, scope.project.id=754d04e2573f4c81b21775be5d8d103e) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:32:50.899842 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a7786f-8622-4c41-860e-14a02a51353e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:50.904895 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 185/361] 10.222.0.23 () {56 vars in 1101 bytes} [Sat Oct 1 20:32:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:50.905047 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a7786f-8622-4c41-860e-14a02a51353e None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:50.905237 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7990849-6665-46e3-8e8e-45224f5bd6ee None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:50.910168 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 177/362] 10.222.0.23 () {56 vars in 1376 bytes} [Sat Oct 1 20:32:50 2022] GET /identity/v3/role_assignments?group.id=0c478203200b4ad29d0e6cb8e8f028b7&scope.project.id=754d04e2573f4c81b21775be5d8d103e&role.id=8789e127ff4549b4883a92a87573ad3e => generated 260 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:50.911419 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1e2933-aee0-427c-b240-e6328efac677 None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:50.911704 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1e2933-aee0-427c-b240-e6328efac677 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:50.911975 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1e2933-aee0-427c-b240-e6328efac677 None None] PATH_INFO: `/` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:50.913511 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 178/363] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:32:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:32:50.918808 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1e2933-aee0-427c-b240-e6328efac677 None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:50.981453 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:51.028762 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7990849-6665-46e3-8e8e-45224f5bd6ee None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:51.039579 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:51.055013 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1e2933-aee0-427c-b240-e6328efac677 None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:51.069724 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b668cd33-4bde-40d0-adcf-fe56b4274013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:51.070871 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668cd33-4bde-40d0-adcf-fe56b4274013 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:51.071391 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668cd33-4bde-40d0-adcf-fe56b4274013 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:51.071865 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668cd33-4bde-40d0-adcf-fe56b4274013 None admin] PATH_INFO: `/v3/roles` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:51.072791 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b668cd33-4bde-40d0-adcf-fe56b4274013 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:32:51.073329 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b668cd33-4bde-40d0-adcf-fe56b4274013 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:51.075257 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b668cd33-4bde-40d0-adcf-fe56b4274013 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:51.085586 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 186/364] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Oct 1 20:32:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:51.086946 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b668cd33-4bde-40d0-adcf-fe56b4274013 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:51.095678 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dec640-a956-4eca-8261-b3f31b00dec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:51.096298 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dec640-a956-4eca-8261-b3f31b00dec7 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:51.096695 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dec640-a956-4eca-8261-b3f31b00dec7 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:51.096885 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dec640-a956-4eca-8261-b3f31b00dec7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:51.097609 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dec640-a956-4eca-8261-b3f31b00dec7 None admin] RBAC: Adding query filter params (role.id=593409d904954a0f8039eda5aa05fc40, user.id=c0a3f05f6e5849339c0dbb4b15c93ead, scope.system=all) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:32:51.097916 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dec640-a956-4eca-8261-b3f31b00dec7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:51.099438 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dec640-a956-4eca-8261-b3f31b00dec7 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:51.115022 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 179/365] 10.222.0.23 () {56 vars in 1308 bytes} [Sat Oct 1 20:32:50 2022] GET /identity/v3/role_assignments?user.id=c0a3f05f6e5849339c0dbb4b15c93ead&scope.system=all&role.id=593409d904954a0f8039eda5aa05fc40 => generated 510 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:51.117272 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b006d0c-986d-41e6-8f82-8cb3db77d7f0 None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:51.117549 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b006d0c-986d-41e6-8f82-8cb3db77d7f0 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:51.117821 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b006d0c-986d-41e6-8f82-8cb3db77d7f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:51.138801 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-5b006d0c-986d-41e6-8f82-8cb3db77d7f0 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:32:51.140781 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-5b006d0c-986d-41e6-8f82-8cb3db77d7f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:32:51.210199 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b668cd33-4bde-40d0-adcf-fe56b4274013 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:51.227427 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 180/366] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:32:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 20:32:51.228632 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b006d0c-986d-41e6-8f82-8cb3db77d7f0 None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:51.238597 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:51.267075 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0860a72b-a900-493a-9cc1-342ebc455d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:51.268097 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0860a72b-a900-493a-9cc1-342ebc455d65 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:51.268603 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0860a72b-a900-493a-9cc1-342ebc455d65 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:51.269070 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0860a72b-a900-493a-9cc1-342ebc455d65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:51.360880 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:51.389570 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0860a72b-a900-493a-9cc1-342ebc455d65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:51.391829 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0860a72b-a900-493a-9cc1-342ebc455d65 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:51.396052 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b006d0c-986d-41e6-8f82-8cb3db77d7f0 None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:51.437417 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df7c47f-6d2d-4550-b740-391b7e2229d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:51.438210 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df7c47f-6d2d-4550-b740-391b7e2229d5 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:51.438493 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df7c47f-6d2d-4550-b740-391b7e2229d5 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:51.438770 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df7c47f-6d2d-4550-b740-391b7e2229d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:51.522334 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df7c47f-6d2d-4550-b740-391b7e2229d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:51.523916 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df7c47f-6d2d-4550-b740-391b7e2229d5 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:51.632819 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 187/367] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Oct 1 20:32:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 01 20:32:51.636016 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:51.641980 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0860a72b-a900-493a-9cc1-342ebc455d65 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:51.663547 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 181/368] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Oct 1 20:32:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 01 20:32:51.672398 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df7c47f-6d2d-4550-b740-391b7e2229d5 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:51.676168 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:51.830579 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0860a72b-a900-493a-9cc1-342ebc455d65 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:51.854355 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df7c47f-6d2d-4550-b740-391b7e2229d5 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:51.881196 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea9a3fb-1838-4a1d-aa16-aae7d534d9b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:51.882300 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9a3fb-1838-4a1d-aa16-aae7d534d9b8 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:51.882592 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9a3fb-1838-4a1d-aa16-aae7d534d9b8 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:51.882868 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9a3fb-1838-4a1d-aa16-aae7d534d9b8 None admin] PATH_INFO: `/v3/projects/4357ac4f8a434b11a19fefd8982470d2` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:51.885510 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea9a3fb-1838-4a1d-aa16-aae7d534d9b8 None admin] RBAC: Authorizing `identity:get_project(project_id=4357ac4f8a434b11a19fefd8982470d2)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:51.887185 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea9a3fb-1838-4a1d-aa16-aae7d534d9b8 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:51.892499 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 188/369] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Oct 1 20:32:51 2022] GET /identity/v3/projects/4357ac4f8a434b11a19fefd8982470d2 => generated 302 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 20:32:51.894031 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea9a3fb-1838-4a1d-aa16-aae7d534d9b8 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:51.902052 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b520833-4f86-4145-9337-feeb7ae3223d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:51.902685 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b520833-4f86-4145-9337-feeb7ae3223d None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:51.902963 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b520833-4f86-4145-9337-feeb7ae3223d None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:51.903211 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b520833-4f86-4145-9337-feeb7ae3223d None admin] PATH_INFO: `/v3/projects/4357ac4f8a434b11a19fefd8982470d2` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:51.904355 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b520833-4f86-4145-9337-feeb7ae3223d None admin] RBAC: Authorizing `identity:get_project(project_id=4357ac4f8a434b11a19fefd8982470d2)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:51.906101 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b520833-4f86-4145-9337-feeb7ae3223d None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:51.908057 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 182/370] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Oct 1 20:32:51 2022] GET /identity/v3/projects/4357ac4f8a434b11a19fefd8982470d2 => generated 302 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 20:32:51.908941 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b520833-4f86-4145-9337-feeb7ae3223d None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:51.965426 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:52.033527 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:52.053555 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea9a3fb-1838-4a1d-aa16-aae7d534d9b8 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:52.064892 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b520833-4f86-4145-9337-feeb7ae3223d None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:52.111943 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d767ea7d-16c8-4b12-ad71-439c11a394eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:52.113035 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d767ea7d-16c8-4b12-ad71-439c11a394eb None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:52.113779 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d767ea7d-16c8-4b12-ad71-439c11a394eb None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:52.114245 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d767ea7d-16c8-4b12-ad71-439c11a394eb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:52.122097 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f23714-12cd-4485-a643-2619c05c5c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:52.122761 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f23714-12cd-4485-a643-2619c05c5c80 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:52.123177 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f23714-12cd-4485-a643-2619c05c5c80 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:52.123454 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f23714-12cd-4485-a643-2619c05c5c80 None admin] PATH_INFO: `/v3/groups/0c478203200b4ad29d0e6cb8e8f028b7` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:52.125635 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f23714-12cd-4485-a643-2619c05c5c80 None admin] RBAC: Authorizing `identity:get_group(group_id=0c478203200b4ad29d0e6cb8e8f028b7)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:52.127098 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f23714-12cd-4485-a643-2619c05c5c80 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:52.128569 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d767ea7d-16c8-4b12-ad71-439c11a394eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 20:32:52.129436 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 183/371] 10.222.0.23 () {56 vars in 1180 bytes} [Sat Oct 1 20:32:51 2022] GET /identity/v3/groups/0c478203200b4ad29d0e6cb8e8f028b7 => generated 226 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:52.130330 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f23714-12cd-4485-a643-2619c05c5c80 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:52.136675 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-d767ea7d-16c8-4b12-ad71-439c11a394eb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 20:32:52.136675 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:32:52.136675 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:32:52.136675 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:32:52.136675 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:32:52.136675 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:32:52.136675 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:32:52.136675 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:32:52.136675 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:32:52.136675 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:32:52.136675 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:32:52.136675 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:32:52.136675 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 20:32:52.136675 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 20:32:52.136675 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 20:32:52.136675 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 20:32:52.137590 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 20:32:52.137590 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 20:32:52.137590 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 20:32:52.137590 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 20:32:52.137590 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:32:52.137590 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:32:52.137590 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:32:52.137590 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:32:52.137590 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:32:52.137590 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:32:52.137590 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:32:52.137590 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:32:52.137590 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:32:52.137590 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:32:52.137590 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:32:52.137590 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:32:52.138405 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:32:52.138405 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:32:52.138405 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:32:52.138405 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:32:52.138405 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 20:32:52.138405 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 20:32:52.138405 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 20:32:52.138405 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 20:32:52.138405 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 20:32:52.138405 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 20:32:52.138405 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 20:32:52.138405 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:32:52.142854 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 189/372] 10.222.0.23 () {56 vars in 1096 bytes} [Sat Oct 1 20:32:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:32:52.144012 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d767ea7d-16c8-4b12-ad71-439c11a394eb None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:52.300643 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f23714-12cd-4485-a643-2619c05c5c80 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:52.312390 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d767ea7d-16c8-4b12-ad71-439c11a394eb None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:52.313839 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:52.357922 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb6f4ed-476f-415e-ae4a-08bc710f128e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:52.358731 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb6f4ed-476f-415e-ae4a-08bc710f128e None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:52.359012 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb6f4ed-476f-415e-ae4a-08bc710f128e None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:52.359379 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb6f4ed-476f-415e-ae4a-08bc710f128e None admin] PATH_INFO: `/v3/groups/0c478203200b4ad29d0e6cb8e8f028b7` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:52.360698 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb6f4ed-476f-415e-ae4a-08bc710f128e None admin] RBAC: Authorizing `identity:get_group(group_id=0c478203200b4ad29d0e6cb8e8f028b7)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:52.362846 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb6f4ed-476f-415e-ae4a-08bc710f128e None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:52.364227 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 184/373] 10.222.0.23 () {56 vars in 1180 bytes} [Sat Oct 1 20:32:52 2022] GET /identity/v3/groups/0c478203200b4ad29d0e6cb8e8f028b7 => generated 226 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:52.364486 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97ad46d-fd74-4757-80ed-29e8ed044a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:52.365077 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb6f4ed-476f-415e-ae4a-08bc710f128e None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:52.365995 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ad46d-fd74-4757-80ed-29e8ed044a69 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:52.366477 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ad46d-fd74-4757-80ed-29e8ed044a69 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:52.366886 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ad46d-fd74-4757-80ed-29e8ed044a69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:52.368763 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97ad46d-fd74-4757-80ed-29e8ed044a69 None admin] RBAC: Adding query filter params (group.id=0c478203200b4ad29d0e6cb8e8f028b7, role.id=82138515a02147ccb30f8d56863aab87, scope.project.id=4357ac4f8a434b11a19fefd8982470d2) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:32:52.370842 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97ad46d-fd74-4757-80ed-29e8ed044a69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:52.373541 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97ad46d-fd74-4757-80ed-29e8ed044a69 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:52.382974 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 190/374] 10.222.0.23 () {56 vars in 1376 bytes} [Sat Oct 1 20:32:52 2022] GET /identity/v3/role_assignments?group.id=0c478203200b4ad29d0e6cb8e8f028b7&scope.project.id=4357ac4f8a434b11a19fefd8982470d2&role.id=82138515a02147ccb30f8d56863aab87 => generated 260 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:52.384121 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97ad46d-fd74-4757-80ed-29e8ed044a69 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:52.418604 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:52.516733 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb6f4ed-476f-415e-ae4a-08bc710f128e None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:52.569983 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a53362-fc14-41fb-86f3-51ec975ee97b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:52.570688 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a53362-fc14-41fb-86f3-51ec975ee97b None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:52.570987 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a53362-fc14-41fb-86f3-51ec975ee97b None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:52.571259 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a53362-fc14-41fb-86f3-51ec975ee97b None admin] PATH_INFO: `/v3/roles` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:52.571925 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a53362-fc14-41fb-86f3-51ec975ee97b None admin] RBAC: Adding query filter params (name=admin) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:32:52.572223 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a53362-fc14-41fb-86f3-51ec975ee97b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:52.573934 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a53362-fc14-41fb-86f3-51ec975ee97b None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:52.586989 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 185/375] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Oct 1 20:32:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:52.594439 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a53362-fc14-41fb-86f3-51ec975ee97b None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:52.665968 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:52.671552 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97ad46d-fd74-4757-80ed-29e8ed044a69 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:52.738906 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efe35dd-9295-41fe-88ba-7a34a3ffa87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:52.739985 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efe35dd-9295-41fe-88ba-7a34a3ffa87a None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:52.740379 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efe35dd-9295-41fe-88ba-7a34a3ffa87a None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:52.740853 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efe35dd-9295-41fe-88ba-7a34a3ffa87a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:52.741679 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efe35dd-9295-41fe-88ba-7a34a3ffa87a None admin] RBAC: Adding query filter params (group.id=0c478203200b4ad29d0e6cb8e8f028b7, role.id=8789e127ff4549b4883a92a87573ad3e, scope.project.id=4357ac4f8a434b11a19fefd8982470d2) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:32:52.742084 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efe35dd-9295-41fe-88ba-7a34a3ffa87a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:52.743743 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efe35dd-9295-41fe-88ba-7a34a3ffa87a None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:52.752491 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 191/376] 10.222.0.23 () {56 vars in 1376 bytes} [Sat Oct 1 20:32:52 2022] GET /identity/v3/role_assignments?group.id=0c478203200b4ad29d0e6cb8e8f028b7&scope.project.id=4357ac4f8a434b11a19fefd8982470d2&role.id=8789e127ff4549b4883a92a87573ad3e => generated 260 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:52.786678 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a53362-fc14-41fb-86f3-51ec975ee97b None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:52.831477 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7449f3f6-afee-4bad-a116-85fe594b716c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:52.832098 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7449f3f6-afee-4bad-a116-85fe594b716c None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:52.832374 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7449f3f6-afee-4bad-a116-85fe594b716c None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:52.832672 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7449f3f6-afee-4bad-a116-85fe594b716c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:52.935443 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7449f3f6-afee-4bad-a116-85fe594b716c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:52.937415 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7449f3f6-afee-4bad-a116-85fe594b716c None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:52.987626 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:53.074352 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 186/377] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Oct 1 20:32:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 01 20:32:53.081720 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efe35dd-9295-41fe-88ba-7a34a3ffa87a None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:53.203244 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:53.236841 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efe35dd-9295-41fe-88ba-7a34a3ffa87a None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:53.277235 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aa1e49-2459-491f-8b8d-1734f297fbb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:53.277867 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa1e49-2459-491f-8b8d-1734f297fbb6 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:53.278144 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa1e49-2459-491f-8b8d-1734f297fbb6 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:53.278415 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa1e49-2459-491f-8b8d-1734f297fbb6 None admin] PATH_INFO: `/v3/projects/15f2619d8f534f3eace3cce529462560` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:53.279624 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aa1e49-2459-491f-8b8d-1734f297fbb6 None admin] RBAC: Authorizing `identity:get_project(project_id=15f2619d8f534f3eace3cce529462560)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:53.281648 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aa1e49-2459-491f-8b8d-1734f297fbb6 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:53.283598 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 192/378] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Oct 1 20:32:53 2022] GET /identity/v3/projects/15f2619d8f534f3eace3cce529462560 => generated 344 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:53.288839 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7449f3f6-afee-4bad-a116-85fe594b716c None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:53.425205 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7449f3f6-afee-4bad-a116-85fe594b716c None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:53.470025 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa25484-1310-42a6-a4cc-66d22413b873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:53.470578 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa25484-1310-42a6-a4cc-66d22413b873 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:53.470852 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa25484-1310-42a6-a4cc-66d22413b873 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:53.471121 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa25484-1310-42a6-a4cc-66d22413b873 None admin] PATH_INFO: `/v3/groups/95b31af3d75c49ad8ce22baad0921d5a` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:53.478491 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:53.482129 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa25484-1310-42a6-a4cc-66d22413b873 None admin] RBAC: Authorizing `identity:get_group(group_id=95b31af3d75c49ad8ce22baad0921d5a)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:53.484316 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa25484-1310-42a6-a4cc-66d22413b873 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:53.486438 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 187/379] 10.222.0.23 () {56 vars in 1180 bytes} [Sat Oct 1 20:32:53 2022] GET /identity/v3/groups/95b31af3d75c49ad8ce22baad0921d5a => generated 229 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:53.491764 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aa1e49-2459-491f-8b8d-1734f297fbb6 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:53.612342 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aa1e49-2459-491f-8b8d-1734f297fbb6 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:53.662660 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9215c46-31e8-4437-a534-055c703e9d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:53.663327 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9215c46-31e8-4437-a534-055c703e9d17 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:53.663604 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9215c46-31e8-4437-a534-055c703e9d17 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:53.663877 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9215c46-31e8-4437-a534-055c703e9d17 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:53.664690 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9215c46-31e8-4437-a534-055c703e9d17 None admin] RBAC: Adding query filter params (group.id=95b31af3d75c49ad8ce22baad0921d5a, role.id=d11e7ba2f1fa41ff8ea8dda2a8d1466f, scope.project.id=15f2619d8f534f3eace3cce529462560) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:32:53.665001 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9215c46-31e8-4437-a534-055c703e9d17 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:53.666430 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9215c46-31e8-4437-a534-055c703e9d17 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:53.674713 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 193/380] 10.222.0.23 () {56 vars in 1376 bytes} [Sat Oct 1 20:32:53 2022] GET /identity/v3/role_assignments?group.id=95b31af3d75c49ad8ce22baad0921d5a&scope.project.id=15f2619d8f534f3eace3cce529462560&role.id=d11e7ba2f1fa41ff8ea8dda2a8d1466f => generated 260 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:53.903777 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9679827-6520-436a-85cf-d9fceacb9a35 None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:53.904123 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9679827-6520-436a-85cf-d9fceacb9a35 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:53.904240 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9679827-6520-436a-85cf-d9fceacb9a35 None None] PATH_INFO: `/` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:53.906975 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 188/381] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:32:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:32:53.912409 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e38e78e-3f48-4762-8b08-ea87a0df20b3 None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:53.912815 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e38e78e-3f48-4762-8b08-ea87a0df20b3 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:53.913105 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e38e78e-3f48-4762-8b08-ea87a0df20b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:53.928132 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:53.939662 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-5e38e78e-3f48-4762-8b08-ea87a0df20b3 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:32:53.940996 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-5e38e78e-3f48-4762-8b08-ea87a0df20b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:32:54.031538 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 194/382] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:32:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 20:32:54.266017 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62045491-e1b7-4edd-ab2c-cf4546c0c774 None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:54.267012 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62045491-e1b7-4edd-ab2c-cf4546c0c774 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:54.267497 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62045491-e1b7-4edd-ab2c-cf4546c0c774 None None] PATH_INFO: `/` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:54.269349 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 189/383] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:32:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:32:54.274368 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc0e9ae-e782-4e4d-a801-b41776b560b8 None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:54.275199 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc0e9ae-e782-4e4d-a801-b41776b560b8 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:54.275693 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc0e9ae-e782-4e4d-a801-b41776b560b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:54.305687 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-ffc0e9ae-e782-4e4d-a801-b41776b560b8 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:32:54.307258 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-ffc0e9ae-e782-4e4d-a801-b41776b560b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:32:54.386145 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62045491-e1b7-4edd-ab2c-cf4546c0c774 None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:54.401868 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 195/384] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:32:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 20:32:54.514429 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62045491-e1b7-4edd-ab2c-cf4546c0c774 None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:54.556500 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55edfaa5-d63e-4ed0-8be7-b84fc8d6b94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:54.557156 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55edfaa5-d63e-4ed0-8be7-b84fc8d6b94f None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:54.557436 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55edfaa5-d63e-4ed0-8be7-b84fc8d6b94f None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:54.557711 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55edfaa5-d63e-4ed0-8be7-b84fc8d6b94f None admin] PATH_INFO: `/v3/roles/member` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:54.571765 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55edfaa5-d63e-4ed0-8be7-b84fc8d6b94f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 20:32:54.577265 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application [None req-55edfaa5-d63e-4ed0-8be7-b84fc8d6b94f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 01 20:32:54.577265 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:32:54.577265 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:32:54.577265 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:32:54.577265 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:32:54.577265 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:32:54.577265 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:32:54.577265 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:32:54.577265 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:32:54.577265 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:32:54.577265 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:32:54.577265 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:32:54.577265 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 20:32:54.577265 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 20:32:54.577265 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 20:32:54.577265 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 20:32:54.578157 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 20:32:54.578157 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 20:32:54.578157 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 20:32:54.578157 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 20:32:54.578157 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:32:54.578157 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:32:54.578157 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:32:54.578157 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:32:54.578157 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:32:54.578157 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:32:54.578157 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:32:54.578157 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application with Lock( Oct 01 20:32:54.578157 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:32:54.578157 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:32:54.578157 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:32:54.578157 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:32:54.578998 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:32:54.578998 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:32:54.578998 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:32:54.578998 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:32:54.578998 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 20:32:54.578998 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 20:32:54.578998 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 20:32:54.578998 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 20:32:54.578998 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 20:32:54.578998 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 20:32:54.578998 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 01 20:32:54.578998 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:32:54.578998 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 190/385] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Oct 1 20:32:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:32:54.584680 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc0e9ae-e782-4e4d-a801-b41776b560b8 None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:54.672065 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:54.712546 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc0e9ae-e782-4e4d-a801-b41776b560b8 None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:54.765668 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d5d48-f7c1-4c37-833d-9c48cab595fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:54.766196 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d5d48-f7c1-4c37-833d-9c48cab595fe None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:54.766471 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d5d48-f7c1-4c37-833d-9c48cab595fe None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:54.766831 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d5d48-f7c1-4c37-833d-9c48cab595fe None admin] PATH_INFO: `/v3/roles` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:54.767403 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879d5d48-f7c1-4c37-833d-9c48cab595fe None admin] RBAC: Adding query filter params (name=member) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:32:54.767699 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879d5d48-f7c1-4c37-833d-9c48cab595fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:54.769100 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879d5d48-f7c1-4c37-833d-9c48cab595fe None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:54.778331 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 196/386] 10.222.0.23 () {56 vars in 1101 bytes} [Sat Oct 1 20:32:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:54.783609 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55edfaa5-d63e-4ed0-8be7-b84fc8d6b94f None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:54.875284 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:54.922569 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55edfaa5-d63e-4ed0-8be7-b84fc8d6b94f None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:54.962594 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9e4146-22b6-4bf8-b9a1-9db281edda82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:54.963231 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e4146-22b6-4bf8-b9a1-9db281edda82 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:54.963511 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e4146-22b6-4bf8-b9a1-9db281edda82 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:54.963783 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e4146-22b6-4bf8-b9a1-9db281edda82 None admin] PATH_INFO: `/v3/groups/0c478203200b4ad29d0e6cb8e8f028b7` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:54.965881 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d5d48-f7c1-4c37-833d-9c48cab595fe None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:54.966494 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9e4146-22b6-4bf8-b9a1-9db281edda82 None admin] RBAC: Authorizing `identity:get_group(group_id=0c478203200b4ad29d0e6cb8e8f028b7)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:54.968276 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9e4146-22b6-4bf8-b9a1-9db281edda82 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:54.970623 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 191/387] 10.222.0.23 () {56 vars in 1180 bytes} [Sat Oct 1 20:32:54 2022] GET /identity/v3/groups/0c478203200b4ad29d0e6cb8e8f028b7 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:54.975765 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9e4146-22b6-4bf8-b9a1-9db281edda82 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:55.103845 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d5d48-f7c1-4c37-833d-9c48cab595fe None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:55.143540 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06320e6-00db-47a4-bf41-9942806a124f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:55.144263 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06320e6-00db-47a4-bf41-9942806a124f None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:55.144565 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06320e6-00db-47a4-bf41-9942806a124f None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:55.144844 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06320e6-00db-47a4-bf41-9942806a124f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:55.156679 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06320e6-00db-47a4-bf41-9942806a124f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 20:32:55.163590 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-e06320e6-00db-47a4-bf41-9942806a124f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 01 20:32:55.163590 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:32:55.163590 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:32:55.163590 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:32:55.163590 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:32:55.163590 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:32:55.163590 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:32:55.163590 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:32:55.163590 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:32:55.163590 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:32:55.163590 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:32:55.163590 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:32:55.163590 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 20:32:55.163590 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 20:32:55.163590 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 20:32:55.163590 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 20:32:55.164563 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 20:32:55.164563 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 20:32:55.164563 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 20:32:55.164563 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 20:32:55.164563 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:32:55.164563 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:32:55.164563 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:32:55.164563 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:32:55.164563 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:32:55.164563 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:32:55.164563 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:32:55.164563 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:32:55.164563 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:32:55.164563 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:32:55.164563 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:32:55.164563 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:32:55.165392 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:32:55.165392 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:32:55.165392 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:32:55.165392 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:32:55.165392 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 20:32:55.165392 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 20:32:55.165392 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 20:32:55.165392 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 20:32:55.165392 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 20:32:55.165392 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 20:32:55.165392 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 01 20:32:55.165392 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:32:55.165392 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 197/388] 10.222.0.23 () {56 vars in 1114 bytes} [Sat Oct 1 20:32:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 01 20:32:55.166694 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:55.181944 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06320e6-00db-47a4-bf41-9942806a124f None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:55.257852 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9e4146-22b6-4bf8-b9a1-9db281edda82 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:55.312953 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:55.334306 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7b473f-57bf-4c00-a78f-1aeb869d6c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:55.334949 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b473f-57bf-4c00-a78f-1aeb869d6c11 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:55.335229 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b473f-57bf-4c00-a78f-1aeb869d6c11 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:55.335506 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b473f-57bf-4c00-a78f-1aeb869d6c11 None admin] PATH_INFO: `/v3/projects/754d04e2573f4c81b21775be5d8d103e` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:55.338743 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7b473f-57bf-4c00-a78f-1aeb869d6c11 None admin] RBAC: Authorizing `identity:get_project(project_id=754d04e2573f4c81b21775be5d8d103e)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:55.340211 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7b473f-57bf-4c00-a78f-1aeb869d6c11 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:55.344891 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 192/389] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Oct 1 20:32:54 2022] GET /identity/v3/projects/754d04e2573f4c81b21775be5d8d103e => generated 298 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 20:32:55.348279 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7b473f-57bf-4c00-a78f-1aeb869d6c11 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:55.391989 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06320e6-00db-47a4-bf41-9942806a124f None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:55.451476 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c375fa-da51-41f8-a23b-574fa8444de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:55.452192 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c375fa-da51-41f8-a23b-574fa8444de0 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:55.452602 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c375fa-da51-41f8-a23b-574fa8444de0 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:55.452986 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c375fa-da51-41f8-a23b-574fa8444de0 None admin] PATH_INFO: `/v3/roles` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:55.453663 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c375fa-da51-41f8-a23b-574fa8444de0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:32:55.453974 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c375fa-da51-41f8-a23b-574fa8444de0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:55.455505 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c375fa-da51-41f8-a23b-574fa8444de0 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:55.464326 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 198/390] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Oct 1 20:32:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 20:32:55.473489 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c375fa-da51-41f8-a23b-574fa8444de0 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:55.562082 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7b473f-57bf-4c00-a78f-1aeb869d6c11 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:55.572688 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:55.633251 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c375fa-da51-41f8-a23b-574fa8444de0 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:55.641802 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebc93c7-7862-4379-b50e-b1f62d5e0572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:55.642540 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebc93c7-7862-4379-b50e-b1f62d5e0572 None admin] REQUEST_METHOD: `PUT` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:55.642761 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebc93c7-7862-4379-b50e-b1f62d5e0572 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:55.643032 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebc93c7-7862-4379-b50e-b1f62d5e0572 None admin] PATH_INFO: `/v3/projects/754d04e2573f4c81b21775be5d8d103e/groups/0c478203200b4ad29d0e6cb8e8f028b7/roles/82138515a02147ccb30f8d56863aab87` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:55.649850 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebc93c7-7862-4379-b50e-b1f62d5e0572 None admin] RBAC: Authorizing `identity:create_grant(project_id=754d04e2573f4c81b21775be5d8d103e, group_id=0c478203200b4ad29d0e6cb8e8f028b7, role_id=82138515a02147ccb30f8d56863aab87)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:55.651323 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebc93c7-7862-4379-b50e-b1f62d5e0572 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:55.672021 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad6d07f-6160-42ee-bc9d-d9d2f991ec94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:55.672882 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad6d07f-6160-42ee-bc9d-d9d2f991ec94 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:55.673154 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad6d07f-6160-42ee-bc9d-d9d2f991ec94 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:55.674202 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad6d07f-6160-42ee-bc9d-d9d2f991ec94 None admin] PATH_INFO: `/v3/groups/0c478203200b4ad29d0e6cb8e8f028b7` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:55.676268 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad6d07f-6160-42ee-bc9d-d9d2f991ec94 None admin] RBAC: Authorizing `identity:get_group(group_id=0c478203200b4ad29d0e6cb8e8f028b7)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:55.677940 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad6d07f-6160-42ee-bc9d-d9d2f991ec94 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:55.678562 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 193/391] 10.222.0.23 () {58 vars in 1442 bytes} [Sat Oct 1 20:32:55 2022] PUT /identity/v3/projects/754d04e2573f4c81b21775be5d8d103e/groups/0c478203200b4ad29d0e6cb8e8f028b7/roles/82138515a02147ccb30f8d56863aab87 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 20:32:55.679966 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bf5007-e09b-4ee1-99b1-edaa634f7d5b None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:55.684553 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 199/392] 10.222.0.23 () {56 vars in 1180 bytes} [Sat Oct 1 20:32:55 2022] GET /identity/v3/groups/0c478203200b4ad29d0e6cb8e8f028b7 => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:55.685230 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bf5007-e09b-4ee1-99b1-edaa634f7d5b None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:55.685768 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bf5007-e09b-4ee1-99b1-edaa634f7d5b None None] PATH_INFO: `/` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:55.686642 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad6d07f-6160-42ee-bc9d-d9d2f991ec94 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:55.688214 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 194/393] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:32:55 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:32:55.696341 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da13937-952e-425d-9080-d7912edb9f53 None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:55.697141 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da13937-952e-425d-9080-d7912edb9f53 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:55.697623 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da13937-952e-425d-9080-d7912edb9f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:55.724603 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-7da13937-952e-425d-9080-d7912edb9f53 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:32:55.726808 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-7da13937-952e-425d-9080-d7912edb9f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:32:55.846009 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:55.876708 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad6d07f-6160-42ee-bc9d-d9d2f991ec94 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:55.885703 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 195/394] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:32:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 20:32:55.907598 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:55.925960 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6de781-c010-4aba-a7b7-90c9689edd1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:55.926600 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6de781-c010-4aba-a7b7-90c9689edd1a None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:55.926874 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6de781-c010-4aba-a7b7-90c9689edd1a None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:55.927139 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6de781-c010-4aba-a7b7-90c9689edd1a None admin] PATH_INFO: `/v3/projects/754d04e2573f4c81b21775be5d8d103e` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:55.928297 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6de781-c010-4aba-a7b7-90c9689edd1a None admin] RBAC: Authorizing `identity:get_project(project_id=754d04e2573f4c81b21775be5d8d103e)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:55.929771 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6de781-c010-4aba-a7b7-90c9689edd1a None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:55.931793 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 200/395] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Oct 1 20:32:55 2022] GET /identity/v3/projects/754d04e2573f4c81b21775be5d8d103e => generated 298 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:55.937844 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da13937-952e-425d-9080-d7912edb9f53 None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:56.064508 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da13937-952e-425d-9080-d7912edb9f53 None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:56.117298 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfd6a48-5a96-416b-8539-a39a965b9dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:56.117961 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd6a48-5a96-416b-8539-a39a965b9dc2 None admin] REQUEST_METHOD: `PUT` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:56.118234 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd6a48-5a96-416b-8539-a39a965b9dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:56.118502 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd6a48-5a96-416b-8539-a39a965b9dc2 None admin] PATH_INFO: `/v3/projects/754d04e2573f4c81b21775be5d8d103e/groups/0c478203200b4ad29d0e6cb8e8f028b7/roles/8789e127ff4549b4883a92a87573ad3e` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:56.125767 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfd6a48-5a96-416b-8539-a39a965b9dc2 None admin] RBAC: Authorizing `identity:create_grant(project_id=754d04e2573f4c81b21775be5d8d103e, group_id=0c478203200b4ad29d0e6cb8e8f028b7, role_id=8789e127ff4549b4883a92a87573ad3e)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:56.127213 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfd6a48-5a96-416b-8539-a39a965b9dc2 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:56.145436 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 196/396] 10.222.0.23 () {58 vars in 1442 bytes} [Sat Oct 1 20:32:55 2022] PUT /identity/v3/projects/754d04e2573f4c81b21775be5d8d103e/groups/0c478203200b4ad29d0e6cb8e8f028b7/roles/8789e127ff4549b4883a92a87573ad3e => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 20:32:56.285645 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6de781-c010-4aba-a7b7-90c9689edd1a None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:56.413258 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6de781-c010-4aba-a7b7-90c9689edd1a None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:56.473264 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82769af6-ea8e-4e26-b49c-7a695ebaba4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:56.473915 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82769af6-ea8e-4e26-b49c-7a695ebaba4f None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:56.474196 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82769af6-ea8e-4e26-b49c-7a695ebaba4f None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:56.474471 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82769af6-ea8e-4e26-b49c-7a695ebaba4f None admin] PATH_INFO: `/v3/roles/member` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:56.492341 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82769af6-ea8e-4e26-b49c-7a695ebaba4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 20:32:56.497652 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-82769af6-ea8e-4e26-b49c-7a695ebaba4f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 01 20:32:56.497652 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:32:56.497652 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:32:56.497652 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:32:56.497652 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:32:56.497652 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:32:56.497652 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:32:56.497652 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:32:56.497652 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:32:56.497652 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:32:56.497652 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:32:56.497652 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:32:56.497652 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 20:32:56.497652 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 20:32:56.497652 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 20:32:56.497652 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 20:32:56.498598 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 20:32:56.498598 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 20:32:56.498598 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 20:32:56.498598 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 20:32:56.498598 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:32:56.498598 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:32:56.498598 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:32:56.498598 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:32:56.498598 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:32:56.498598 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:32:56.498598 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:32:56.498598 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:32:56.498598 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:32:56.498598 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:32:56.498598 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:32:56.498598 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:32:56.499440 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:32:56.499440 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:32:56.499440 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:32:56.499440 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:32:56.499440 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 20:32:56.499440 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 20:32:56.499440 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 20:32:56.499440 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 20:32:56.499440 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 20:32:56.499440 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 20:32:56.499440 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 01 20:32:56.499440 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:32:56.499440 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 201/397] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Oct 1 20:32:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:32:56.505221 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfd6a48-5a96-416b-8539-a39a965b9dc2 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:56.555695 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:56.586519 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0752db78-b9f5-4383-8d1b-1a5bfba2d03e None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:56.586790 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0752db78-b9f5-4383-8d1b-1a5bfba2d03e None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:56.587058 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0752db78-b9f5-4383-8d1b-1a5bfba2d03e None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:56.588516 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 202/398] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:32:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 01 20:32:56.594958 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f5a7b8-7662-462b-af70-ccba77dee144 None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:56.595339 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f5a7b8-7662-462b-af70-ccba77dee144 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:56.595690 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f5a7b8-7662-462b-af70-ccba77dee144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:56.621616 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-34f5a7b8-7662-462b-af70-ccba77dee144 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:32:56.622819 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-34f5a7b8-7662-462b-af70-ccba77dee144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:32:56.658235 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfd6a48-5a96-416b-8539-a39a965b9dc2 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:56.715145 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:56.724811 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b455c26e-4fb8-4982-82f6-a5a840e40eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:56.725484 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b455c26e-4fb8-4982-82f6-a5a840e40eb6 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:56.725765 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b455c26e-4fb8-4982-82f6-a5a840e40eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:56.726038 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b455c26e-4fb8-4982-82f6-a5a840e40eb6 None admin] PATH_INFO: `/v3/roles` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:56.726925 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b455c26e-4fb8-4982-82f6-a5a840e40eb6 None admin] RBAC: Adding query filter params (name=member) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:32:56.727233 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b455c26e-4fb8-4982-82f6-a5a840e40eb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:56.729105 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b455c26e-4fb8-4982-82f6-a5a840e40eb6 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:56.739754 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 197/399] 10.222.0.23 () {56 vars in 1101 bytes} [Sat Oct 1 20:32:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:56.745551 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b455c26e-4fb8-4982-82f6-a5a840e40eb6 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:56.768934 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 203/400] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:32:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 01 20:32:56.813600 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831be53f-1344-4036-bdbd-fa138cf61448 None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:56.813903 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831be53f-1344-4036-bdbd-fa138cf61448 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:56.814151 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831be53f-1344-4036-bdbd-fa138cf61448 None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:56.815485 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 204/401] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:32:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 01 20:32:56.820608 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb89c7f9-0104-4fe8-9e67-e12c26638d3d None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:56.820924 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb89c7f9-0104-4fe8-9e67-e12c26638d3d None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:56.821167 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb89c7f9-0104-4fe8-9e67-e12c26638d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:56.845623 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-bb89c7f9-0104-4fe8-9e67-e12c26638d3d None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:32:56.846828 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-bb89c7f9-0104-4fe8-9e67-e12c26638d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:32:56.938675 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b455c26e-4fb8-4982-82f6-a5a840e40eb6 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:56.957555 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:56.981818 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 205/402] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:32:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 01 20:32:57.006519 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e45642-2a9c-4e18-bd90-9d906f0f0d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:57.007151 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e45642-2a9c-4e18-bd90-9d906f0f0d02 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:57.007595 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e45642-2a9c-4e18-bd90-9d906f0f0d02 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:57.009231 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e45642-2a9c-4e18-bd90-9d906f0f0d02 None admin] PATH_INFO: `/v3/groups/0c478203200b4ad29d0e6cb8e8f028b7` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:57.010353 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e45642-2a9c-4e18-bd90-9d906f0f0d02 None admin] RBAC: Authorizing `identity:get_group(group_id=0c478203200b4ad29d0e6cb8e8f028b7)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:57.011807 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e45642-2a9c-4e18-bd90-9d906f0f0d02 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:57.013384 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 198/403] 10.222.0.23 () {56 vars in 1180 bytes} [Sat Oct 1 20:32:56 2022] GET /identity/v3/groups/0c478203200b4ad29d0e6cb8e8f028b7 => generated 226 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:57.019662 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb89c7f9-0104-4fe8-9e67-e12c26638d3d None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:57.155394 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb89c7f9-0104-4fe8-9e67-e12c26638d3d None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:57.188765 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:57.215977 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d63be1-f235-4dd0-bb41-7d8257b85f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:57.216626 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d63be1-f235-4dd0-bb41-7d8257b85f1a None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:57.216905 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d63be1-f235-4dd0-bb41-7d8257b85f1a None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:57.217178 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d63be1-f235-4dd0-bb41-7d8257b85f1a None admin] PATH_INFO: `/v3/projects/4357ac4f8a434b11a19fefd8982470d2` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:57.218409 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d63be1-f235-4dd0-bb41-7d8257b85f1a None admin] RBAC: Authorizing `identity:get_project(project_id=4357ac4f8a434b11a19fefd8982470d2)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:57.219953 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d63be1-f235-4dd0-bb41-7d8257b85f1a None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:57.221621 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 206/404] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Oct 1 20:32:57 2022] GET /identity/v3/projects/4357ac4f8a434b11a19fefd8982470d2 => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:57.226986 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e45642-2a9c-4e18-bd90-9d906f0f0d02 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:57.227287 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d63be1-f235-4dd0-bb41-7d8257b85f1a None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:57.359924 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d63be1-f235-4dd0-bb41-7d8257b85f1a None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:57.400144 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f181b623-465a-414f-9cf9-15655e52cabf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:57.400957 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f181b623-465a-414f-9cf9-15655e52cabf None admin] REQUEST_METHOD: `PUT` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:57.401542 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f181b623-465a-414f-9cf9-15655e52cabf None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:57.401916 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f181b623-465a-414f-9cf9-15655e52cabf None admin] PATH_INFO: `/v3/projects/4357ac4f8a434b11a19fefd8982470d2/groups/0c478203200b4ad29d0e6cb8e8f028b7/roles/82138515a02147ccb30f8d56863aab87` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:57.404080 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f181b623-465a-414f-9cf9-15655e52cabf None admin] RBAC: Authorizing `identity:create_grant(project_id=4357ac4f8a434b11a19fefd8982470d2, group_id=0c478203200b4ad29d0e6cb8e8f028b7, role_id=82138515a02147ccb30f8d56863aab87)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:57.406175 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f181b623-465a-414f-9cf9-15655e52cabf None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:57.427222 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 207/405] 10.222.0.23 () {58 vars in 1442 bytes} [Sat Oct 1 20:32:57 2022] PUT /identity/v3/projects/4357ac4f8a434b11a19fefd8982470d2/groups/0c478203200b4ad29d0e6cb8e8f028b7/roles/82138515a02147ccb30f8d56863aab87 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 01 20:32:57.436353 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e45642-2a9c-4e18-bd90-9d906f0f0d02 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:57.449812 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f181b623-465a-414f-9cf9-15655e52cabf None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:57.478894 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6cdcba-2edb-4a80-b5d6-c4f71a7655d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:57.479341 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6cdcba-2edb-4a80-b5d6-c4f71a7655d4 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:57.479694 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6cdcba-2edb-4a80-b5d6-c4f71a7655d4 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:57.479974 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6cdcba-2edb-4a80-b5d6-c4f71a7655d4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:57.492430 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6cdcba-2edb-4a80-b5d6-c4f71a7655d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 20:32:57.495254 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:57.499791 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application [None req-ac6cdcba-2edb-4a80-b5d6-c4f71a7655d4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 01 20:32:57.499791 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:32:57.499791 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:32:57.499791 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:32:57.499791 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:32:57.499791 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:32:57.499791 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:32:57.499791 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:32:57.499791 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:32:57.499791 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:32:57.499791 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:32:57.499791 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:32:57.499791 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 20:32:57.499791 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 20:32:57.499791 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 20:32:57.499791 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 20:32:57.500826 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 20:32:57.500826 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 20:32:57.500826 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 20:32:57.500826 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 20:32:57.500826 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:32:57.500826 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:32:57.500826 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:32:57.500826 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:32:57.500826 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:32:57.500826 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:32:57.500826 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:32:57.500826 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application with Lock( Oct 01 20:32:57.500826 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:32:57.500826 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:32:57.500826 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:32:57.500826 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:32:57.501640 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:32:57.501640 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:32:57.501640 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:32:57.501640 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:32:57.501640 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 20:32:57.501640 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 20:32:57.501640 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 20:32:57.501640 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 20:32:57.501640 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 20:32:57.501640 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 20:32:57.501640 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 01 20:32:57.501640 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:32:57.502250 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 199/406] 10.222.0.23 () {56 vars in 1114 bytes} [Sat Oct 1 20:32:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:32:57.510438 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6cdcba-2edb-4a80-b5d6-c4f71a7655d4 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:57.599998 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f181b623-465a-414f-9cf9-15655e52cabf None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:57.628018 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:57.640391 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eab0f7-b506-4667-9936-47e75b462ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:57.641051 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eab0f7-b506-4667-9936-47e75b462ade None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:57.641326 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eab0f7-b506-4667-9936-47e75b462ade None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:57.641593 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eab0f7-b506-4667-9936-47e75b462ade None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:57.653895 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eab0f7-b506-4667-9936-47e75b462ade None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 20:32:57.659253 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-13eab0f7-b506-4667-9936-47e75b462ade None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 20:32:57.659253 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:32:57.659253 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:32:57.659253 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:32:57.659253 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:32:57.659253 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:32:57.659253 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:32:57.659253 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:32:57.659253 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:32:57.659253 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:32:57.659253 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:32:57.659253 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:32:57.659253 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 20:32:57.659253 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 20:32:57.659253 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 20:32:57.659253 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 20:32:57.660179 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 20:32:57.660179 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 20:32:57.660179 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 20:32:57.660179 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 20:32:57.660179 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:32:57.660179 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:32:57.660179 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:32:57.660179 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:32:57.660179 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:32:57.660179 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:32:57.660179 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:32:57.660179 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:32:57.660179 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:32:57.660179 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:32:57.660179 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:32:57.660179 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:32:57.661055 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:32:57.661055 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:32:57.661055 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:32:57.661055 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:32:57.661055 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 20:32:57.661055 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 20:32:57.661055 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 20:32:57.661055 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 20:32:57.661055 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 20:32:57.661055 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 20:32:57.661055 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 20:32:57.661055 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:32:57.665056 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 208/407] 10.222.0.23 () {56 vars in 1096 bytes} [Sat Oct 1 20:32:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:32:57.666738 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eab0f7-b506-4667-9936-47e75b462ade None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:57.766241 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6cdcba-2edb-4a80-b5d6-c4f71a7655d4 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:57.779103 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:57.789046 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eab0f7-b506-4667-9936-47e75b462ade None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:57.809535 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621276b6-deef-443e-9bf7-cb28ab10d4d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:57.810589 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621276b6-deef-443e-9bf7-cb28ab10d4d5 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:57.811201 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621276b6-deef-443e-9bf7-cb28ab10d4d5 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:57.811991 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621276b6-deef-443e-9bf7-cb28ab10d4d5 None admin] PATH_INFO: `/v3/roles` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:57.812955 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621276b6-deef-443e-9bf7-cb28ab10d4d5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:32:57.813514 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621276b6-deef-443e-9bf7-cb28ab10d4d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:57.815178 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621276b6-deef-443e-9bf7-cb28ab10d4d5 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:57.825172 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 200/408] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Oct 1 20:32:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 20:32:57.832465 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45d7a7b-a4c0-4b6e-8f0f-27210653f0bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:57.833101 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d7a7b-a4c0-4b6e-8f0f-27210653f0bc None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:57.833375 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d7a7b-a4c0-4b6e-8f0f-27210653f0bc None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:57.833647 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d7a7b-a4c0-4b6e-8f0f-27210653f0bc None admin] PATH_INFO: `/v3/roles` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:57.834007 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621276b6-deef-443e-9bf7-cb28ab10d4d5 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:57.834314 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45d7a7b-a4c0-4b6e-8f0f-27210653f0bc None admin] RBAC: Adding query filter params (name=admin) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:32:57.834613 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45d7a7b-a4c0-4b6e-8f0f-27210653f0bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:57.836270 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45d7a7b-a4c0-4b6e-8f0f-27210653f0bc None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:57.847203 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 209/409] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Oct 1 20:32:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 20:32:57.852830 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45d7a7b-a4c0-4b6e-8f0f-27210653f0bc None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:57.979275 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621276b6-deef-443e-9bf7-cb28ab10d4d5 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:57.980835 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:58.019022 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facc0dda-f0de-4ede-af4f-fcbd340324e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:58.019658 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc0dda-f0de-4ede-af4f-fcbd340324e3 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:58.019938 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc0dda-f0de-4ede-af4f-fcbd340324e3 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:58.020207 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc0dda-f0de-4ede-af4f-fcbd340324e3 None admin] PATH_INFO: `/v3/groups/0c478203200b4ad29d0e6cb8e8f028b7` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:58.021345 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facc0dda-f0de-4ede-af4f-fcbd340324e3 None admin] RBAC: Authorizing `identity:get_group(group_id=0c478203200b4ad29d0e6cb8e8f028b7)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:58.022860 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facc0dda-f0de-4ede-af4f-fcbd340324e3 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:58.028979 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 201/410] 10.222.0.23 () {56 vars in 1180 bytes} [Sat Oct 1 20:32:57 2022] GET /identity/v3/groups/0c478203200b4ad29d0e6cb8e8f028b7 => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:58.031077 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facc0dda-f0de-4ede-af4f-fcbd340324e3 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:58.139712 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facc0dda-f0de-4ede-af4f-fcbd340324e3 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:58.154093 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45d7a7b-a4c0-4b6e-8f0f-27210653f0bc None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:58.206980 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4cbf4d-e53f-48e6-a472-d7af815e0139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:58.207885 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4cbf4d-e53f-48e6-a472-d7af815e0139 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:58.208303 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4cbf4d-e53f-48e6-a472-d7af815e0139 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:58.208790 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4cbf4d-e53f-48e6-a472-d7af815e0139 None admin] PATH_INFO: `/v3/groups/95b31af3d75c49ad8ce22baad0921d5a` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:58.210320 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4cbf4d-e53f-48e6-a472-d7af815e0139 None admin] RBAC: Authorizing `identity:get_group(group_id=95b31af3d75c49ad8ce22baad0921d5a)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:58.212044 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4cbf4d-e53f-48e6-a472-d7af815e0139 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:58.213102 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684607f0-a0c8-423e-a8cd-63bb811f2ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:58.213770 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684607f0-a0c8-423e-a8cd-63bb811f2ee5 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:58.214050 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684607f0-a0c8-423e-a8cd-63bb811f2ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:58.214329 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684607f0-a0c8-423e-a8cd-63bb811f2ee5 None admin] PATH_INFO: `/v3/projects/4357ac4f8a434b11a19fefd8982470d2` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:58.214562 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 210/411] 10.222.0.23 () {56 vars in 1180 bytes} [Sat Oct 1 20:32:57 2022] GET /identity/v3/groups/95b31af3d75c49ad8ce22baad0921d5a => generated 229 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:58.221542 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684607f0-a0c8-423e-a8cd-63bb811f2ee5 None admin] RBAC: Authorizing `identity:get_project(project_id=4357ac4f8a434b11a19fefd8982470d2)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:58.221739 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4cbf4d-e53f-48e6-a472-d7af815e0139 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:58.223052 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684607f0-a0c8-423e-a8cd-63bb811f2ee5 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:58.228580 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 202/412] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Oct 1 20:32:58 2022] GET /identity/v3/projects/4357ac4f8a434b11a19fefd8982470d2 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:58.232104 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684607f0-a0c8-423e-a8cd-63bb811f2ee5 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:58.278785 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:58.304936 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:58.412820 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4cbf4d-e53f-48e6-a472-d7af815e0139 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:58.435802 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684607f0-a0c8-423e-a8cd-63bb811f2ee5 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:58.477658 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d9985e-3891-444f-8f33-cf6ee07cf87b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:58.478327 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d9985e-3891-444f-8f33-cf6ee07cf87b None admin] REQUEST_METHOD: `PUT` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:58.478606 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d9985e-3891-444f-8f33-cf6ee07cf87b None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:58.478878 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d9985e-3891-444f-8f33-cf6ee07cf87b None admin] PATH_INFO: `/v3/projects/4357ac4f8a434b11a19fefd8982470d2/groups/0c478203200b4ad29d0e6cb8e8f028b7/roles/8789e127ff4549b4883a92a87573ad3e` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:58.481082 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d9985e-3891-444f-8f33-cf6ee07cf87b None admin] RBAC: Authorizing `identity:create_grant(project_id=4357ac4f8a434b11a19fefd8982470d2, group_id=0c478203200b4ad29d0e6cb8e8f028b7, role_id=8789e127ff4549b4883a92a87573ad3e)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:58.483075 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d9985e-3891-444f-8f33-cf6ee07cf87b None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:58.489304 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4cd170-b86b-4f4d-af27-df7a89c079c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:58.489950 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4cd170-b86b-4f4d-af27-df7a89c079c5 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:58.490231 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4cd170-b86b-4f4d-af27-df7a89c079c5 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:58.490559 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4cd170-b86b-4f4d-af27-df7a89c079c5 None admin] PATH_INFO: `/v3/projects/15f2619d8f534f3eace3cce529462560` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:58.491718 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4cd170-b86b-4f4d-af27-df7a89c079c5 None admin] RBAC: Authorizing `identity:get_project(project_id=15f2619d8f534f3eace3cce529462560)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:58.493265 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4cd170-b86b-4f4d-af27-df7a89c079c5 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:58.494960 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 211/413] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Oct 1 20:32:58 2022] GET /identity/v3/projects/15f2619d8f534f3eace3cce529462560 => generated 344 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 20:32:58.504848 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 203/414] 10.222.0.23 () {58 vars in 1442 bytes} [Sat Oct 1 20:32:58 2022] PUT /identity/v3/projects/4357ac4f8a434b11a19fefd8982470d2/groups/0c478203200b4ad29d0e6cb8e8f028b7/roles/8789e127ff4549b4883a92a87573ad3e => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 01 20:32:58.505254 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4cd170-b86b-4f4d-af27-df7a89c079c5 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:58.613497 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:58.622462 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4cd170-b86b-4f4d-af27-df7a89c079c5 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:58.659617 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158f0be0-1587-4f01-abe7-2ea39e7fa4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:58.660284 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158f0be0-1587-4f01-abe7-2ea39e7fa4a3 None admin] REQUEST_METHOD: `PUT` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:58.660581 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158f0be0-1587-4f01-abe7-2ea39e7fa4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:58.660906 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158f0be0-1587-4f01-abe7-2ea39e7fa4a3 None admin] PATH_INFO: `/v3/projects/15f2619d8f534f3eace3cce529462560/groups/95b31af3d75c49ad8ce22baad0921d5a/roles/d11e7ba2f1fa41ff8ea8dda2a8d1466f` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:58.662892 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158f0be0-1587-4f01-abe7-2ea39e7fa4a3 None admin] RBAC: Authorizing `identity:create_grant(project_id=15f2619d8f534f3eace3cce529462560, group_id=95b31af3d75c49ad8ce22baad0921d5a, role_id=d11e7ba2f1fa41ff8ea8dda2a8d1466f)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:58.664380 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158f0be0-1587-4f01-abe7-2ea39e7fa4a3 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:58.678922 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ce206-a2bb-4827-8440-c3fa1425905d None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:58.679490 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ce206-a2bb-4827-8440-c3fa1425905d None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:58.679574 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ce206-a2bb-4827-8440-c3fa1425905d None None] PATH_INFO: `/` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:58.681246 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 204/415] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:32:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:32:58.686853 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 212/416] 10.222.0.23 () {58 vars in 1442 bytes} [Sat Oct 1 20:32:58 2022] PUT /identity/v3/projects/15f2619d8f534f3eace3cce529462560/groups/95b31af3d75c49ad8ce22baad0921d5a/roles/d11e7ba2f1fa41ff8ea8dda2a8d1466f => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 20:32:58.692590 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7325976b-1cb3-401b-ba47-b5b618e6b35f None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:58.693226 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7325976b-1cb3-401b-ba47-b5b618e6b35f None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:58.693449 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7325976b-1cb3-401b-ba47-b5b618e6b35f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:58.717741 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-7325976b-1cb3-401b-ba47-b5b618e6b35f None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:32:58.719032 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-7325976b-1cb3-401b-ba47-b5b618e6b35f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:32:58.815602 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 205/417] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:32:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 20:32:59.048714 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a0f57-7ef4-43e6-ae84-ab9847602177 None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:59.049078 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a0f57-7ef4-43e6-ae84-ab9847602177 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:59.049270 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a0f57-7ef4-43e6-ae84-ab9847602177 None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:59.050768 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 213/418] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:32:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:32:59.056278 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f915bb57-eb07-47e7-a0cc-d3d4f99a77e2 None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:59.056600 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f915bb57-eb07-47e7-a0cc-d3d4f99a77e2 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:59.056885 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f915bb57-eb07-47e7-a0cc-d3d4f99a77e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:59.078307 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-f915bb57-eb07-47e7-a0cc-d3d4f99a77e2 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:32:59.079834 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-f915bb57-eb07-47e7-a0cc-d3d4f99a77e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:32:59.102320 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:59.163765 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 206/419] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:32:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 20:32:59.226529 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236a0f57-7ef4-43e6-ae84-ab9847602177 None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:59.374451 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236a0f57-7ef4-43e6-ae84-ab9847602177 None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:59.416289 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628b4964-804e-45a4-bc61-fbe220ebb466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:59.417315 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b4964-804e-45a4-bc61-fbe220ebb466 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:59.417888 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b4964-804e-45a4-bc61-fbe220ebb466 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:59.418375 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b4964-804e-45a4-bc61-fbe220ebb466 None admin] PATH_INFO: `/v3/roles/member` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:59.439369 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628b4964-804e-45a4-bc61-fbe220ebb466 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 20:32:59.444866 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-628b4964-804e-45a4-bc61-fbe220ebb466 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 01 20:32:59.444866 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:32:59.444866 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:32:59.444866 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:32:59.444866 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:32:59.444866 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:32:59.444866 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:32:59.444866 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:32:59.444866 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:32:59.444866 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:32:59.444866 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:32:59.444866 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:32:59.444866 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 20:32:59.444866 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 20:32:59.444866 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 20:32:59.444866 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 20:32:59.445773 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 20:32:59.445773 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 20:32:59.445773 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 20:32:59.445773 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 20:32:59.445773 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:32:59.445773 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:32:59.445773 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:32:59.445773 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:32:59.445773 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:32:59.445773 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:32:59.445773 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:32:59.445773 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:32:59.445773 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:32:59.445773 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:32:59.445773 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:32:59.445773 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:32:59.446570 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:32:59.446570 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:32:59.446570 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:32:59.446570 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:32:59.446570 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 20:32:59.446570 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 20:32:59.446570 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 20:32:59.446570 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 20:32:59.446570 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 20:32:59.446570 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 20:32:59.446570 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 01 20:32:59.446570 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:32:59.448831 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 214/420] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Oct 1 20:32:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:32:59.468138 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f915bb57-eb07-47e7-a0cc-d3d4f99a77e2 None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:59.604494 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f915bb57-eb07-47e7-a0cc-d3d4f99a77e2 None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:59.648477 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7433a8b9-0be1-4262-a367-bdcdfd5a0690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:59.649030 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433a8b9-0be1-4262-a367-bdcdfd5a0690 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:59.649306 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433a8b9-0be1-4262-a367-bdcdfd5a0690 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:59.649577 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433a8b9-0be1-4262-a367-bdcdfd5a0690 None admin] PATH_INFO: `/v3/roles` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:59.650234 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7433a8b9-0be1-4262-a367-bdcdfd5a0690 None admin] RBAC: Adding query filter params (name=member) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:32:59.650531 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7433a8b9-0be1-4262-a367-bdcdfd5a0690 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:32:59.651891 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7433a8b9-0be1-4262-a367-bdcdfd5a0690 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:32:59.661646 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 207/421] 10.222.0.23 () {56 vars in 1101 bytes} [Sat Oct 1 20:32:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:32:59.667018 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628b4964-804e-45a4-bc61-fbe220ebb466 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:59.678393 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7433a8b9-0be1-4262-a367-bdcdfd5a0690 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:32:59.695863 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:59.713963 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:32:59.855875 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628b4964-804e-45a4-bc61-fbe220ebb466 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:59.870219 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7433a8b9-0be1-4262-a367-bdcdfd5a0690 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:32:59.920948 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f532f12-0140-425c-ac38-4d16032e72ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:59.921474 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f532f12-0140-425c-ac38-4d16032e72ad None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:59.921751 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f532f12-0140-425c-ac38-4d16032e72ad None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:59.922018 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f532f12-0140-425c-ac38-4d16032e72ad None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:59.932672 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f532f12-0140-425c-ac38-4d16032e72ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 20:32:59.934476 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b230e50-f525-4d05-af5c-5ac498281f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:32:59.935311 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b230e50-f525-4d05-af5c-5ac498281f50 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:32:59.935810 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b230e50-f525-4d05-af5c-5ac498281f50 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:32:59.937016 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b230e50-f525-4d05-af5c-5ac498281f50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:32:59.940545 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application [None req-4f532f12-0140-425c-ac38-4d16032e72ad None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 01 20:32:59.940545 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:32:59.940545 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:32:59.940545 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:32:59.940545 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:32:59.940545 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:32:59.940545 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:32:59.940545 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:32:59.940545 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:32:59.940545 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:32:59.940545 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:32:59.940545 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:32:59.940545 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 20:32:59.940545 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 20:32:59.940545 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 20:32:59.940545 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 20:32:59.941427 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 20:32:59.941427 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 20:32:59.941427 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 20:32:59.941427 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 20:32:59.941427 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:32:59.941427 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:32:59.941427 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:32:59.941427 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:32:59.941427 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:32:59.941427 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:32:59.941427 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:32:59.941427 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application with Lock( Oct 01 20:32:59.941427 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:32:59.941427 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:32:59.941427 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:32:59.941427 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:32:59.942245 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:32:59.942245 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:32:59.942245 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:32:59.942245 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:32:59.942245 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 20:32:59.942245 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 20:32:59.942245 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 20:32:59.942245 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 20:32:59.942245 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 20:32:59.942245 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 20:32:59.942245 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 01 20:32:59.942245 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:32:59.944628 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 208/422] 10.222.0.23 () {56 vars in 1114 bytes} [Sat Oct 1 20:32:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 01 20:32:59.946078 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f532f12-0140-425c-ac38-4d16032e72ad None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:00.034993 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:00.074055 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f532f12-0140-425c-ac38-4d16032e72ad None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:00.085746 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b230e50-f525-4d05-af5c-5ac498281f50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:00.087211 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b230e50-f525-4d05-af5c-5ac498281f50 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:00.116993 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:00.150926 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6111d4-ea1b-47e3-ae28-ced6ada8a815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:00.151533 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6111d4-ea1b-47e3-ae28-ced6ada8a815 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:00.151803 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6111d4-ea1b-47e3-ae28-ced6ada8a815 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:00.152067 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6111d4-ea1b-47e3-ae28-ced6ada8a815 None admin] PATH_INFO: `/v3/roles` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:00.152746 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6111d4-ea1b-47e3-ae28-ced6ada8a815 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:00.153044 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6111d4-ea1b-47e3-ae28-ced6ada8a815 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:00.154421 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6111d4-ea1b-47e3-ae28-ced6ada8a815 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:00.185218 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 209/423] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Oct 1 20:32:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 20:33:00.197558 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6111d4-ea1b-47e3-ae28-ced6ada8a815 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:00.258850 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 215/424] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Oct 1 20:32:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 592 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 01 20:33:00.268215 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b230e50-f525-4d05-af5c-5ac498281f50 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:00.408367 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6111d4-ea1b-47e3-ae28-ced6ada8a815 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:00.468505 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b230e50-f525-4d05-af5c-5ac498281f50 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:00.471990 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe6fe35-bc46-47cb-972d-f57b22c65b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:00.473313 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe6fe35-bc46-47cb-972d-f57b22c65b47 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:00.473313 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe6fe35-bc46-47cb-972d-f57b22c65b47 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:00.473313 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe6fe35-bc46-47cb-972d-f57b22c65b47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:00.484603 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:00.486665 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:00.510569 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a6aa91-0b0d-4deb-8794-919a173a02b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:00.511481 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6aa91-0b0d-4deb-8794-919a173a02b3 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:00.511961 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6aa91-0b0d-4deb-8794-919a173a02b3 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:00.512405 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6aa91-0b0d-4deb-8794-919a173a02b3 None admin] PATH_INFO: `/v3/projects/754d04e2573f4c81b21775be5d8d103e` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:00.514453 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a6aa91-0b0d-4deb-8794-919a173a02b3 None admin] RBAC: Authorizing `identity:get_project(project_id=754d04e2573f4c81b21775be5d8d103e)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:00.516368 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a6aa91-0b0d-4deb-8794-919a173a02b3 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:00.518709 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 216/425] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Oct 1 20:33:00 2022] GET /identity/v3/projects/754d04e2573f4c81b21775be5d8d103e => generated 298 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 20:33:00.520145 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c41f0-bf81-42a5-abf6-4fd431a69e07 None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:00.520736 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c41f0-bf81-42a5-abf6-4fd431a69e07 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:00.521211 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c41f0-bf81-42a5-abf6-4fd431a69e07 None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:00.526807 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 217/426] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:33:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:33:00.527934 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c41f0-bf81-42a5-abf6-4fd431a69e07 None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:00.557996 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe6fe35-bc46-47cb-972d-f57b22c65b47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:00.559737 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe6fe35-bc46-47cb-972d-f57b22c65b47 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:00.657746 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c41f0-bf81-42a5-abf6-4fd431a69e07 None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:00.684276 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 210/427] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Oct 1 20:33:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 01 20:33:00.685802 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e5a09-0de5-4eab-b097-191cfad2bfed None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:00.686698 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e5a09-0de5-4eab-b097-191cfad2bfed None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:00.687029 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e5a09-0de5-4eab-b097-191cfad2bfed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:00.696254 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91396aab-0cf9-4548-a289-9eb1b46efbf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:00.697506 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91396aab-0cf9-4548-a289-9eb1b46efbf9 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:00.698001 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91396aab-0cf9-4548-a289-9eb1b46efbf9 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:00.698468 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91396aab-0cf9-4548-a289-9eb1b46efbf9 None admin] PATH_INFO: `/v3/groups/0c478203200b4ad29d0e6cb8e8f028b7` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:00.699789 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91396aab-0cf9-4548-a289-9eb1b46efbf9 None admin] RBAC: Authorizing `identity:get_group(group_id=0c478203200b4ad29d0e6cb8e8f028b7)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:00.701619 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91396aab-0cf9-4548-a289-9eb1b46efbf9 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:00.705194 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 218/428] 10.222.0.23 () {56 vars in 1180 bytes} [Sat Oct 1 20:33:00 2022] GET /identity/v3/groups/0c478203200b4ad29d0e6cb8e8f028b7 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:00.706222 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91396aab-0cf9-4548-a289-9eb1b46efbf9 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:00.707183 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-cc1e5a09-0de5-4eab-b097-191cfad2bfed None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:33:00.708369 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-cc1e5a09-0de5-4eab-b097-191cfad2bfed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:33:00.748222 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:00.774243 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:00.791949 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 211/429] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:33:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 20:33:00.797639 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1e5a09-0de5-4eab-b097-191cfad2bfed None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:00.838911 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91396aab-0cf9-4548-a289-9eb1b46efbf9 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:00.880872 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d8b657-b480-489a-9a6e-df1b7a2e9f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:00.881748 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8b657-b480-489a-9a6e-df1b7a2e9f18 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:00.882025 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8b657-b480-489a-9a6e-df1b7a2e9f18 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:00.882296 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8b657-b480-489a-9a6e-df1b7a2e9f18 None admin] PATH_INFO: `/v3/projects/754d04e2573f4c81b21775be5d8d103e` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:00.883437 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d8b657-b480-489a-9a6e-df1b7a2e9f18 None admin] RBAC: Authorizing `identity:get_project(project_id=754d04e2573f4c81b21775be5d8d103e)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:00.885182 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d8b657-b480-489a-9a6e-df1b7a2e9f18 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:00.887644 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 219/430] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Oct 1 20:33:00 2022] GET /identity/v3/projects/754d04e2573f4c81b21775be5d8d103e => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:00.898630 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d8b657-b480-489a-9a6e-df1b7a2e9f18 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:01.006460 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1e5a09-0de5-4eab-b097-191cfad2bfed None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:01.067654 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d8b657-b480-489a-9a6e-df1b7a2e9f18 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:01.079860 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902e998f-c15b-402e-aeb0-2849042a9f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:01.080694 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902e998f-c15b-402e-aeb0-2849042a9f8f None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:01.081066 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902e998f-c15b-402e-aeb0-2849042a9f8f None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:01.081430 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902e998f-c15b-402e-aeb0-2849042a9f8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:01.082364 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902e998f-c15b-402e-aeb0-2849042a9f8f None admin] RBAC: Adding query filter params (group.id=0c478203200b4ad29d0e6cb8e8f028b7, role.id=82138515a02147ccb30f8d56863aab87, scope.project.id=754d04e2573f4c81b21775be5d8d103e) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:01.082777 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902e998f-c15b-402e-aeb0-2849042a9f8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:01.084361 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902e998f-c15b-402e-aeb0-2849042a9f8f None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:01.090204 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:01.105206 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 212/431] 10.222.0.23 () {56 vars in 1376 bytes} [Sat Oct 1 20:33:00 2022] GET /identity/v3/role_assignments?group.id=0c478203200b4ad29d0e6cb8e8f028b7&scope.project.id=754d04e2573f4c81b21775be5d8d103e&role.id=82138515a02147ccb30f8d56863aab87 => generated 611 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:01.127535 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58386f2-55d7-437a-b16c-49ebb1c1987f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:01.128660 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58386f2-55d7-437a-b16c-49ebb1c1987f None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:01.129162 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58386f2-55d7-437a-b16c-49ebb1c1987f None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:01.129629 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58386f2-55d7-437a-b16c-49ebb1c1987f None admin] PATH_INFO: `/v3/groups/0c478203200b4ad29d0e6cb8e8f028b7` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:01.132436 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58386f2-55d7-437a-b16c-49ebb1c1987f None admin] RBAC: Authorizing `identity:get_group(group_id=0c478203200b4ad29d0e6cb8e8f028b7)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:01.134406 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58386f2-55d7-437a-b16c-49ebb1c1987f None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:01.136745 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 220/432] 10.222.0.23 () {56 vars in 1180 bytes} [Sat Oct 1 20:33:00 2022] GET /identity/v3/groups/0c478203200b4ad29d0e6cb8e8f028b7 => generated 226 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:01.142779 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902e998f-c15b-402e-aeb0-2849042a9f8f None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:01.192436 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:01.240508 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58386f2-55d7-437a-b16c-49ebb1c1987f None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:01.328942 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902e998f-c15b-402e-aeb0-2849042a9f8f None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:01.402712 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df46bd62-1a28-4186-8e8a-eeee278e1a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:01.403342 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46bd62-1a28-4186-8e8a-eeee278e1a83 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:01.403620 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46bd62-1a28-4186-8e8a-eeee278e1a83 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:01.403898 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46bd62-1a28-4186-8e8a-eeee278e1a83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:01.406640 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df46bd62-1a28-4186-8e8a-eeee278e1a83 None admin] RBAC: Adding query filter params (group.id=0c478203200b4ad29d0e6cb8e8f028b7, role.id=8789e127ff4549b4883a92a87573ad3e, scope.project.id=754d04e2573f4c81b21775be5d8d103e) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:01.406977 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df46bd62-1a28-4186-8e8a-eeee278e1a83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:01.409318 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df46bd62-1a28-4186-8e8a-eeee278e1a83 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:01.425838 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 213/433] 10.222.0.23 () {56 vars in 1376 bytes} [Sat Oct 1 20:33:01 2022] GET /identity/v3/role_assignments?group.id=0c478203200b4ad29d0e6cb8e8f028b7&scope.project.id=754d04e2573f4c81b21775be5d8d103e&role.id=8789e127ff4549b4883a92a87573ad3e => generated 611 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:01.447964 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58386f2-55d7-437a-b16c-49ebb1c1987f None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:01.487831 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881a09c5-ec92-4461-a89b-1c1cbbc3b376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:01.488477 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a09c5-ec92-4461-a89b-1c1cbbc3b376 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:01.488800 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a09c5-ec92-4461-a89b-1c1cbbc3b376 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:01.489075 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a09c5-ec92-4461-a89b-1c1cbbc3b376 None admin] PATH_INFO: `/v3/roles/member` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:01.502299 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881a09c5-ec92-4461-a89b-1c1cbbc3b376 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 20:33:01.508162 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-881a09c5-ec92-4461-a89b-1c1cbbc3b376 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 01 20:33:01.508162 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:01.508162 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:01.508162 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:01.508162 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:01.508162 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:01.508162 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:01.508162 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:01.508162 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:01.508162 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:01.508162 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:01.508162 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:01.508162 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 20:33:01.508162 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 20:33:01.508162 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 20:33:01.508162 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 20:33:01.509143 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 20:33:01.509143 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 20:33:01.509143 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 20:33:01.509143 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 20:33:01.509143 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:01.509143 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:01.509143 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:01.509143 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:01.509143 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:01.509143 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:01.509143 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:01.509143 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:01.509143 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:01.509143 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:01.509143 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:01.509143 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:01.509967 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:01.509967 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:01.509967 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:01.509967 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:01.509967 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 20:33:01.509967 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 20:33:01.509967 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 20:33:01.509967 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 20:33:01.509967 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 20:33:01.509967 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 20:33:01.509967 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 01 20:33:01.509967 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:33:01.509967 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 221/434] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Oct 1 20:33:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 01 20:33:01.516323 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df46bd62-1a28-4186-8e8a-eeee278e1a83 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:01.546406 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67770ded-cf48-497f-ad8f-0cf4f73dafa2 None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:01.546763 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67770ded-cf48-497f-ad8f-0cf4f73dafa2 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:01.546922 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67770ded-cf48-497f-ad8f-0cf4f73dafa2 None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:01.549012 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 222/435] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:33:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:33:01.557996 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7915c2-80a7-4c16-89a5-b5de2845419d None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:01.558427 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7915c2-80a7-4c16-89a5-b5de2845419d None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:01.558803 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7915c2-80a7-4c16-89a5-b5de2845419d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:01.599047 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-cf7915c2-80a7-4c16-89a5-b5de2845419d None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:33:01.599047 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-cf7915c2-80a7-4c16-89a5-b5de2845419d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:33:01.655034 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:01.663673 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:01.674386 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df46bd62-1a28-4186-8e8a-eeee278e1a83 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:01.687256 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 223/436] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:33:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 20:33:01.688514 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc983fc-7618-48a1-836c-25c8a3325e3f None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:01.688853 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc983fc-7618-48a1-836c-25c8a3325e3f None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:01.689131 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc983fc-7618-48a1-836c-25c8a3325e3f None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:01.690384 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 224/437] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:33:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:33:01.702610 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a61657-06ce-4a5f-ac1d-902bbabac88c None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:01.703312 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a61657-06ce-4a5f-ac1d-902bbabac88c None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:01.703312 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a61657-06ce-4a5f-ac1d-902bbabac88c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:01.713027 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf59fabd-ddf8-4ebd-a14c-7f804d4aced1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:01.713640 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf59fabd-ddf8-4ebd-a14c-7f804d4aced1 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:01.713936 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf59fabd-ddf8-4ebd-a14c-7f804d4aced1 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:01.714203 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf59fabd-ddf8-4ebd-a14c-7f804d4aced1 None admin] PATH_INFO: `/v3/roles` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:01.714859 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf59fabd-ddf8-4ebd-a14c-7f804d4aced1 None admin] RBAC: Adding query filter params (name=member) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:01.715155 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf59fabd-ddf8-4ebd-a14c-7f804d4aced1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:01.716597 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf59fabd-ddf8-4ebd-a14c-7f804d4aced1 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:01.725364 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-a0a61657-06ce-4a5f-ac1d-902bbabac88c None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:33:01.725672 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 214/438] 10.222.0.23 () {56 vars in 1101 bytes} [Sat Oct 1 20:33:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:01.727022 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-a0a61657-06ce-4a5f-ac1d-902bbabac88c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:33:01.743194 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf59fabd-ddf8-4ebd-a14c-7f804d4aced1 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:01.819283 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 225/439] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:33:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 20:33:01.865757 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf59fabd-ddf8-4ebd-a14c-7f804d4aced1 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:01.902635 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132c20ca-8ed8-4e54-94aa-43729ab12565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:01.903465 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132c20ca-8ed8-4e54-94aa-43729ab12565 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:01.903890 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132c20ca-8ed8-4e54-94aa-43729ab12565 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:01.904307 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132c20ca-8ed8-4e54-94aa-43729ab12565 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:01.933254 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:01.978101 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132c20ca-8ed8-4e54-94aa-43729ab12565 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:01.979606 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132c20ca-8ed8-4e54-94aa-43729ab12565 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:02.049180 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a61657-06ce-4a5f-ac1d-902bbabac88c None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:02.096046 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 215/440] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Oct 1 20:33:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 01 20:33:02.097318 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132c20ca-8ed8-4e54-94aa-43729ab12565 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:02.165875 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:02.187138 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a61657-06ce-4a5f-ac1d-902bbabac88c None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:02.190254 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:02.211153 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132c20ca-8ed8-4e54-94aa-43729ab12565 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:02.223528 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1dc9c0-6107-4a06-bf7c-60b5f7e4a1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:02.224153 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1dc9c0-6107-4a06-bf7c-60b5f7e4a1f0 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:02.224428 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1dc9c0-6107-4a06-bf7c-60b5f7e4a1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:02.224728 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1dc9c0-6107-4a06-bf7c-60b5f7e4a1f0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:02.235475 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1dc9c0-6107-4a06-bf7c-60b5f7e4a1f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 20:33:02.240286 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-be1dc9c0-6107-4a06-bf7c-60b5f7e4a1f0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 01 20:33:02.240286 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:02.240286 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:02.240286 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:02.240286 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:02.240286 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:02.240286 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:02.240286 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:02.240286 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:02.240286 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:02.240286 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:02.240286 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:02.240286 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 20:33:02.240286 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 20:33:02.240286 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 20:33:02.240286 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 20:33:02.241380 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 20:33:02.241380 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 20:33:02.241380 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 20:33:02.241380 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 20:33:02.241380 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:02.241380 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:02.241380 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:02.241380 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:02.241380 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:02.241380 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:02.241380 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:02.241380 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:02.241380 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:02.241380 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:02.241380 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:02.241380 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:02.242360 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:02.242360 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:02.242360 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:02.242360 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:02.242360 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 20:33:02.242360 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 20:33:02.242360 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 20:33:02.242360 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 20:33:02.242360 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 20:33:02.242360 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 20:33:02.242360 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 01 20:33:02.242360 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:33:02.242360 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 226/441] 10.222.0.23 () {56 vars in 1114 bytes} [Sat Oct 1 20:33:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:02.242360 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1dc9c0-6107-4a06-bf7c-60b5f7e4a1f0 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:02.248449 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa35515e-71cd-43ea-bf3e-3223801ca9b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:02.249169 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35515e-71cd-43ea-bf3e-3223801ca9b9 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:02.249445 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35515e-71cd-43ea-bf3e-3223801ca9b9 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:02.249715 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35515e-71cd-43ea-bf3e-3223801ca9b9 None admin] PATH_INFO: `/v3/projects/4357ac4f8a434b11a19fefd8982470d2` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:02.250891 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa35515e-71cd-43ea-bf3e-3223801ca9b9 None admin] RBAC: Authorizing `identity:get_project(project_id=4357ac4f8a434b11a19fefd8982470d2)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:02.252343 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa35515e-71cd-43ea-bf3e-3223801ca9b9 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:02.254005 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 216/442] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Oct 1 20:33:02 2022] GET /identity/v3/projects/4357ac4f8a434b11a19fefd8982470d2 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 20:33:02.254755 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa35515e-71cd-43ea-bf3e-3223801ca9b9 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:02.342260 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1dc9c0-6107-4a06-bf7c-60b5f7e4a1f0 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:02.353696 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa35515e-71cd-43ea-bf3e-3223801ca9b9 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:02.377392 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927ab416-aa96-4c6e-8caa-5bb4f8b23cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:02.377998 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ab416-aa96-4c6e-8caa-5bb4f8b23cdd None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:02.378268 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ab416-aa96-4c6e-8caa-5bb4f8b23cdd None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:02.378531 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ab416-aa96-4c6e-8caa-5bb4f8b23cdd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:02.379090 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:02.387887 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a919a6a-b31a-45d2-8e36-698064e1ff1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:02.388473 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a919a6a-b31a-45d2-8e36-698064e1ff1e None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:02.388589 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927ab416-aa96-4c6e-8caa-5bb4f8b23cdd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 20:33:02.388775 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a919a6a-b31a-45d2-8e36-698064e1ff1e None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:02.389288 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a919a6a-b31a-45d2-8e36-698064e1ff1e None admin] PATH_INFO: `/v3/roles` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:02.389940 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a919a6a-b31a-45d2-8e36-698064e1ff1e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:02.390233 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a919a6a-b31a-45d2-8e36-698064e1ff1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:02.391586 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a919a6a-b31a-45d2-8e36-698064e1ff1e None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:02.393415 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-927ab416-aa96-4c6e-8caa-5bb4f8b23cdd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 20:33:02.393415 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:02.393415 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:02.393415 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:02.393415 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:02.393415 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:02.393415 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:02.393415 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:02.393415 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:02.393415 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:02.393415 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:02.393415 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:02.393415 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 20:33:02.393415 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 20:33:02.393415 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 20:33:02.393415 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 20:33:02.394445 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 20:33:02.394445 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 20:33:02.394445 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 20:33:02.394445 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 20:33:02.394445 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:02.394445 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:02.394445 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:02.394445 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:02.394445 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:02.394445 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:02.394445 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:02.394445 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:02.394445 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:02.394445 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:02.394445 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:02.394445 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:02.395296 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:02.395296 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:02.395296 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:02.395296 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:02.395296 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 20:33:02.395296 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 20:33:02.395296 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 20:33:02.395296 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 20:33:02.395296 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 20:33:02.395296 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 20:33:02.395296 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 20:33:02.395296 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:33:02.395296 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 227/443] 10.222.0.23 () {56 vars in 1096 bytes} [Sat Oct 1 20:33:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:02.395296 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927ab416-aa96-4c6e-8caa-5bb4f8b23cdd None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:02.402384 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 217/444] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Oct 1 20:33:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:02.403002 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a919a6a-b31a-45d2-8e36-698064e1ff1e None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:02.423578 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:02.499137 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927ab416-aa96-4c6e-8caa-5bb4f8b23cdd None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:02.500879 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a919a6a-b31a-45d2-8e36-698064e1ff1e None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:02.532413 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea419a5f-584d-484e-a525-484efb199a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:02.533062 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea419a5f-584d-484e-a525-484efb199a86 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:02.533178 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c503afa7-0828-45c6-96f0-3e042a2d8827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:02.533341 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea419a5f-584d-484e-a525-484efb199a86 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:02.533610 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea419a5f-584d-484e-a525-484efb199a86 None admin] PATH_INFO: `/v3/groups/0c478203200b4ad29d0e6cb8e8f028b7` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:02.533701 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c503afa7-0828-45c6-96f0-3e042a2d8827 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:02.533920 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c503afa7-0828-45c6-96f0-3e042a2d8827 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:02.534190 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c503afa7-0828-45c6-96f0-3e042a2d8827 None admin] PATH_INFO: `/v3/roles` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:02.534708 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea419a5f-584d-484e-a525-484efb199a86 None admin] RBAC: Authorizing `identity:get_group(group_id=0c478203200b4ad29d0e6cb8e8f028b7)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:02.534841 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c503afa7-0828-45c6-96f0-3e042a2d8827 None admin] RBAC: Adding query filter params (name=admin) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:02.535123 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c503afa7-0828-45c6-96f0-3e042a2d8827 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:02.536129 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea419a5f-584d-484e-a525-484efb199a86 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:02.536467 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c503afa7-0828-45c6-96f0-3e042a2d8827 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:02.542822 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 228/445] 10.222.0.23 () {56 vars in 1180 bytes} [Sat Oct 1 20:33:02 2022] GET /identity/v3/groups/0c478203200b4ad29d0e6cb8e8f028b7 => generated 226 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:02.542822 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea419a5f-584d-484e-a525-484efb199a86 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:02.546162 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 218/446] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Oct 1 20:33:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:02.547073 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c503afa7-0828-45c6-96f0-3e042a2d8827 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:02.599853 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:02.630565 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:02.642028 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea419a5f-584d-484e-a525-484efb199a86 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:02.650179 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c503afa7-0828-45c6-96f0-3e042a2d8827 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:02.674368 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45361482-2285-407b-9c32-76a44df57ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:02.674901 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45361482-2285-407b-9c32-76a44df57ddf None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:02.675180 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45361482-2285-407b-9c32-76a44df57ddf None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:02.675450 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45361482-2285-407b-9c32-76a44df57ddf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:02.683709 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fe3190-e0d9-4acd-bcd1-3d85ab299a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:02.684300 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe3190-e0d9-4acd-bcd1-3d85ab299a65 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:02.684601 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe3190-e0d9-4acd-bcd1-3d85ab299a65 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:02.684871 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe3190-e0d9-4acd-bcd1-3d85ab299a65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:02.685572 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fe3190-e0d9-4acd-bcd1-3d85ab299a65 None admin] RBAC: Adding query filter params (group.id=0c478203200b4ad29d0e6cb8e8f028b7, role.id=82138515a02147ccb30f8d56863aab87, scope.project.id=4357ac4f8a434b11a19fefd8982470d2) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:02.686446 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fe3190-e0d9-4acd-bcd1-3d85ab299a65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:02.687865 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fe3190-e0d9-4acd-bcd1-3d85ab299a65 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:02.693863 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 219/447] 10.222.0.23 () {56 vars in 1376 bytes} [Sat Oct 1 20:33:02 2022] GET /identity/v3/role_assignments?group.id=0c478203200b4ad29d0e6cb8e8f028b7&scope.project.id=4357ac4f8a434b11a19fefd8982470d2&role.id=82138515a02147ccb30f8d56863aab87 => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:02.694456 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fe3190-e0d9-4acd-bcd1-3d85ab299a65 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:02.772817 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45361482-2285-407b-9c32-76a44df57ddf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:02.774326 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45361482-2285-407b-9c32-76a44df57ddf None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:02.822062 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fe3190-e0d9-4acd-bcd1-3d85ab299a65 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:02.844060 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:02.869323 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270c8516-47a2-4826-a9c5-72f971f9f4c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:02.869987 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c8516-47a2-4826-a9c5-72f971f9f4c1 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:02.870221 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c8516-47a2-4826-a9c5-72f971f9f4c1 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:02.870492 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c8516-47a2-4826-a9c5-72f971f9f4c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:02.887889 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:02.901808 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 229/448] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Oct 1 20:33:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 01 20:33:02.908512 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45361482-2285-407b-9c32-76a44df57ddf None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:02.945851 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270c8516-47a2-4826-a9c5-72f971f9f4c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:02.947232 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270c8516-47a2-4826-a9c5-72f971f9f4c1 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:03.029412 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45361482-2285-407b-9c32-76a44df57ddf None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:03.068488 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 220/449] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Oct 1 20:33:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 01 20:33:03.070214 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0d7374-d92c-409d-8041-abe53e8d6405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:03.070842 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0d7374-d92c-409d-8041-abe53e8d6405 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:03.071118 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0d7374-d92c-409d-8041-abe53e8d6405 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:03.071390 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0d7374-d92c-409d-8041-abe53e8d6405 None admin] PATH_INFO: `/v3/projects/4357ac4f8a434b11a19fefd8982470d2` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:03.072513 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0d7374-d92c-409d-8041-abe53e8d6405 None admin] RBAC: Authorizing `identity:get_project(project_id=4357ac4f8a434b11a19fefd8982470d2)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:03.074041 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0d7374-d92c-409d-8041-abe53e8d6405 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:03.074700 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270c8516-47a2-4826-a9c5-72f971f9f4c1 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:03.076228 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 230/450] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Oct 1 20:33:02 2022] GET /identity/v3/projects/4357ac4f8a434b11a19fefd8982470d2 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 20:33:03.081906 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0d7374-d92c-409d-8041-abe53e8d6405 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:03.092696 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:03.154766 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:03.188009 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270c8516-47a2-4826-a9c5-72f971f9f4c1 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:03.197581 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0d7374-d92c-409d-8041-abe53e8d6405 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:03.220816 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f90285-9f9f-4152-9fb3-6b305aa46a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:03.221528 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f90285-9f9f-4152-9fb3-6b305aa46a8a None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:03.221799 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f90285-9f9f-4152-9fb3-6b305aa46a8a None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:03.222066 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f90285-9f9f-4152-9fb3-6b305aa46a8a None admin] PATH_INFO: `/v3/projects/15f2619d8f534f3eace3cce529462560` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:03.223158 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f90285-9f9f-4152-9fb3-6b305aa46a8a None admin] RBAC: Authorizing `identity:get_project(project_id=15f2619d8f534f3eace3cce529462560)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:03.224627 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f90285-9f9f-4152-9fb3-6b305aa46a8a None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:03.226222 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 221/451] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Oct 1 20:33:03 2022] GET /identity/v3/projects/15f2619d8f534f3eace3cce529462560 => generated 344 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 20:33:03.231723 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f90285-9f9f-4152-9fb3-6b305aa46a8a None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:03.236629 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd29d9e9-2ea7-4435-8863-96543492ed35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:03.237242 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd29d9e9-2ea7-4435-8863-96543492ed35 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:03.237515 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd29d9e9-2ea7-4435-8863-96543492ed35 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:03.237781 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd29d9e9-2ea7-4435-8863-96543492ed35 None admin] PATH_INFO: `/v3/groups/0c478203200b4ad29d0e6cb8e8f028b7` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:03.238880 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd29d9e9-2ea7-4435-8863-96543492ed35 None admin] RBAC: Authorizing `identity:get_group(group_id=0c478203200b4ad29d0e6cb8e8f028b7)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:03.240288 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd29d9e9-2ea7-4435-8863-96543492ed35 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:03.241861 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 231/452] 10.222.0.23 () {56 vars in 1180 bytes} [Sat Oct 1 20:33:03 2022] GET /identity/v3/groups/0c478203200b4ad29d0e6cb8e8f028b7 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 20:33:03.247460 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd29d9e9-2ea7-4435-8863-96543492ed35 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:03.312543 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:03.331980 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f90285-9f9f-4152-9fb3-6b305aa46a8a None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:03.348336 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd29d9e9-2ea7-4435-8863-96543492ed35 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:03.365180 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44509954-1453-4718-b7c9-055ec6d76a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:03.365798 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44509954-1453-4718-b7c9-055ec6d76a63 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:03.366068 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44509954-1453-4718-b7c9-055ec6d76a63 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:03.366336 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44509954-1453-4718-b7c9-055ec6d76a63 None admin] PATH_INFO: `/v3/groups/95b31af3d75c49ad8ce22baad0921d5a` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:03.367433 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44509954-1453-4718-b7c9-055ec6d76a63 None admin] RBAC: Authorizing `identity:get_group(group_id=95b31af3d75c49ad8ce22baad0921d5a)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:03.368891 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44509954-1453-4718-b7c9-055ec6d76a63 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:03.370598 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 222/453] 10.222.0.23 () {56 vars in 1180 bytes} [Sat Oct 1 20:33:03 2022] GET /identity/v3/groups/95b31af3d75c49ad8ce22baad0921d5a => generated 229 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 20:33:03.374612 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:03.377133 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44509954-1453-4718-b7c9-055ec6d76a63 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:03.382689 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079222da-b454-40b4-8f44-b2339014c79d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:03.383277 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079222da-b454-40b4-8f44-b2339014c79d None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:03.383548 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079222da-b454-40b4-8f44-b2339014c79d None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:03.383815 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079222da-b454-40b4-8f44-b2339014c79d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:03.384541 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079222da-b454-40b4-8f44-b2339014c79d None admin] RBAC: Adding query filter params (group.id=0c478203200b4ad29d0e6cb8e8f028b7, role.id=8789e127ff4549b4883a92a87573ad3e, scope.project.id=4357ac4f8a434b11a19fefd8982470d2) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:03.384852 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079222da-b454-40b4-8f44-b2339014c79d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:03.386267 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079222da-b454-40b4-8f44-b2339014c79d None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:03.392005 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 232/454] 10.222.0.23 () {56 vars in 1376 bytes} [Sat Oct 1 20:33:03 2022] GET /identity/v3/role_assignments?group.id=0c478203200b4ad29d0e6cb8e8f028b7&scope.project.id=4357ac4f8a434b11a19fefd8982470d2&role.id=8789e127ff4549b4883a92a87573ad3e => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 20:33:03.480066 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44509954-1453-4718-b7c9-055ec6d76a63 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:03.515929 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4439b8-2c33-4a5f-8c0f-1c553a5b876d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:03.516564 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4439b8-2c33-4a5f-8c0f-1c553a5b876d None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:03.516841 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4439b8-2c33-4a5f-8c0f-1c553a5b876d None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:03.517106 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4439b8-2c33-4a5f-8c0f-1c553a5b876d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:03.517824 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4439b8-2c33-4a5f-8c0f-1c553a5b876d None admin] RBAC: Adding query filter params (group.id=95b31af3d75c49ad8ce22baad0921d5a, role.id=d11e7ba2f1fa41ff8ea8dda2a8d1466f, scope.project.id=15f2619d8f534f3eace3cce529462560) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:03.518127 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4439b8-2c33-4a5f-8c0f-1c553a5b876d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:03.519596 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4439b8-2c33-4a5f-8c0f-1c553a5b876d None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:03.525987 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 223/455] 10.222.0.23 () {56 vars in 1376 bytes} [Sat Oct 1 20:33:03 2022] GET /identity/v3/role_assignments?group.id=95b31af3d75c49ad8ce22baad0921d5a&scope.project.id=15f2619d8f534f3eace3cce529462560&role.id=d11e7ba2f1fa41ff8ea8dda2a8d1466f => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 20:33:06.244670 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93075a9d-36f6-4e50-a3c9-5013aacdf6dc None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:06.245184 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93075a9d-36f6-4e50-a3c9-5013aacdf6dc None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:06.245184 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93075a9d-36f6-4e50-a3c9-5013aacdf6dc None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:06.246744 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 233/456] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:33:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:33:06.252708 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da82440-ac24-48a0-bb1d-4543bdb3503e None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:06.253521 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da82440-ac24-48a0-bb1d-4543bdb3503e None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:06.254002 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da82440-ac24-48a0-bb1d-4543bdb3503e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:06.271962 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-6da82440-ac24-48a0-bb1d-4543bdb3503e None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:33:06.273477 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-6da82440-ac24-48a0-bb1d-4543bdb3503e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:33:06.283537 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:06.350339 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 224/457] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:33:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 20:33:06.470635 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963bf5a-3642-497f-a92a-ecf27be579b5 None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:06.471270 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963bf5a-3642-497f-a92a-ecf27be579b5 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:06.471767 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963bf5a-3642-497f-a92a-ecf27be579b5 None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:06.473603 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 234/458] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:33:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:33:06.478991 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b75492c-d5d7-4e51-a939-60e378a2aa3e None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:06.479510 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b75492c-d5d7-4e51-a939-60e378a2aa3e None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:06.479990 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b75492c-d5d7-4e51-a939-60e378a2aa3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:06.500128 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-3b75492c-d5d7-4e51-a939-60e378a2aa3e None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:33:06.501682 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-3b75492c-d5d7-4e51-a939-60e378a2aa3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:33:06.578319 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 225/459] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:33:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 20:33:06.654146 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc452831-b81b-48fb-be2b-0078586fb628 None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:06.654481 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc452831-b81b-48fb-be2b-0078586fb628 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:06.654732 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc452831-b81b-48fb-be2b-0078586fb628 None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:06.656337 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 235/460] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:33:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:33:06.661802 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5cdbfe-184d-46fb-845f-4e10a91431ed None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:06.662299 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5cdbfe-184d-46fb-845f-4e10a91431ed None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:06.662767 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5cdbfe-184d-46fb-845f-4e10a91431ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:06.681491 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-4b5cdbfe-184d-46fb-845f-4e10a91431ed None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:33:06.683031 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-4b5cdbfe-184d-46fb-845f-4e10a91431ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:33:06.684273 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc452831-b81b-48fb-be2b-0078586fb628 None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:06.770838 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 226/461] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:33:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 20:33:06.797410 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc452831-b81b-48fb-be2b-0078586fb628 None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:06.831953 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12697e1-c071-4fdf-b319-70d8468bc193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:06.832678 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12697e1-c071-4fdf-b319-70d8468bc193 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:06.832953 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12697e1-c071-4fdf-b319-70d8468bc193 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:06.833216 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12697e1-c071-4fdf-b319-70d8468bc193 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:06.845902 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12697e1-c071-4fdf-b319-70d8468bc193 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:06.848995 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12697e1-c071-4fdf-b319-70d8468bc193 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:06.866937 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-e12697e1-c071-4fdf-b319-70d8468bc193 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:33:06.866937 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:06.866937 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:06.866937 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:06.866937 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:06.866937 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:06.866937 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:06.866937 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:06.866937 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:06.866937 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:06.866937 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:06.866937 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:06.866937 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 20:33:06.866937 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 20:33:06.866937 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 20:33:06.866937 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 20:33:06.868776 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:06.868776 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:06.868776 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:06.868776 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:06.868776 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:06.868776 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:06.868776 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:06.868776 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:06.868776 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:06.868776 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:06.868776 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:06.868776 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:06.868776 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:06.868776 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:06.868776 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:06.868776 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:06.868776 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 20:33:06.869883 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 20:33:06.869883 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:33:06.869883 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:33:06.869883 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 236/462] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Oct 1 20:33:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 01 20:33:06.874279 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5cdbfe-184d-46fb-845f-4e10a91431ed None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:06.877837 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:06.956037 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12697e1-c071-4fdf-b319-70d8468bc193 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:06.981028 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5cdbfe-184d-46fb-845f-4e10a91431ed None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:07.006573 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:07.017323 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9465743b-ae9b-4b24-891f-37d450d6bb43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:07.017936 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9465743b-ae9b-4b24-891f-37d450d6bb43 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:07.018213 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9465743b-ae9b-4b24-891f-37d450d6bb43 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:07.018484 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9465743b-ae9b-4b24-891f-37d450d6bb43 None admin] PATH_INFO: `/v3/domains` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:07.019123 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9465743b-ae9b-4b24-891f-37d450d6bb43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:07.019423 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9465743b-ae9b-4b24-891f-37d450d6bb43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:07.020933 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9465743b-ae9b-4b24-891f-37d450d6bb43 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:07.033229 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 227/463] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Oct 1 20:33:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 20:33:07.034596 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c68929-0692-4cae-96db-bce4df5647c4 None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:07.034885 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c68929-0692-4cae-96db-bce4df5647c4 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:07.035158 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c68929-0692-4cae-96db-bce4df5647c4 None None] PATH_INFO: `/` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:07.036480 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 228/464] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:33:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:33:07.041635 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b60796c-12f2-4b9f-9ec8-b9b2a9b482d3 None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:07.041918 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b60796c-12f2-4b9f-9ec8-b9b2a9b482d3 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:07.042190 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b60796c-12f2-4b9f-9ec8-b9b2a9b482d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:07.060772 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-8b60796c-12f2-4b9f-9ec8-b9b2a9b482d3 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:33:07.062338 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-8b60796c-12f2-4b9f-9ec8-b9b2a9b482d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:33:07.072105 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12697e1-c071-4fdf-b319-70d8468bc193 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:07.106291 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba48901-e6f7-466a-bd16-8672ace7da1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:07.106909 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba48901-e6f7-466a-bd16-8672ace7da1d None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:07.107183 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba48901-e6f7-466a-bd16-8672ace7da1d None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:07.107486 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba48901-e6f7-466a-bd16-8672ace7da1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:07.118298 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba48901-e6f7-466a-bd16-8672ace7da1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:07.119827 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba48901-e6f7-466a-bd16-8672ace7da1d None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:07.124271 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:07.134104 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 229/465] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:33:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 20:33:07.134416 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-bba48901-e6f7-466a-bd16-8672ace7da1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:33:07.134416 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:07.134416 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:07.134416 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:07.134416 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:07.134416 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:07.134416 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:07.134416 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:07.134416 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:07.134416 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:07.134416 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:07.134416 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:07.134416 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 20:33:07.134416 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 20:33:07.134416 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 20:33:07.134416 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 20:33:07.136112 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:07.136112 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:07.136112 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:07.136112 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:07.136112 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:07.136112 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:07.136112 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:07.136112 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:07.136112 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:07.136112 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:07.136112 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:07.136112 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:07.136112 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:07.136112 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:07.136112 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:07.136112 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:07.136112 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 20:33:07.138445 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 20:33:07.138445 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:33:07.138445 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:33:07.139362 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b60796c-12f2-4b9f-9ec8-b9b2a9b482d3 None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:07.139494 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 237/466] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Oct 1 20:33:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 01 20:33:07.139494 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba48901-e6f7-466a-bd16-8672ace7da1d None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:07.244629 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:07.252448 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba48901-e6f7-466a-bd16-8672ace7da1d None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:07.267268 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b60796c-12f2-4b9f-9ec8-b9b2a9b482d3 None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:07.290274 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b066a9-a824-4d2c-8a0b-77ac16eb5f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:07.291087 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b066a9-a824-4d2c-8a0b-77ac16eb5f7d None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:07.291374 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b066a9-a824-4d2c-8a0b-77ac16eb5f7d None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:07.291647 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b066a9-a824-4d2c-8a0b-77ac16eb5f7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:07.302387 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b066a9-a824-4d2c-8a0b-77ac16eb5f7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:07.302513 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adc5659-73f0-41fd-b224-bb3dcef0daee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:07.303094 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc5659-73f0-41fd-b224-bb3dcef0daee None admin] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:07.303370 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc5659-73f0-41fd-b224-bb3dcef0daee None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:07.303639 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc5659-73f0-41fd-b224-bb3dcef0daee None admin] PATH_INFO: `/v3/users` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:07.303827 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b066a9-a824-4d2c-8a0b-77ac16eb5f7d None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:07.304266 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adc5659-73f0-41fd-b224-bb3dcef0daee None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:07.305713 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adc5659-73f0-41fd-b224-bb3dcef0daee None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:07.321098 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-f7b066a9-a824-4d2c-8a0b-77ac16eb5f7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:33:07.321098 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:07.321098 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:07.321098 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:07.321098 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:07.321098 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:07.321098 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:07.321098 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:07.321098 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:07.321098 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:07.321098 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:07.321098 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:07.321098 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 20:33:07.321098 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 20:33:07.321098 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 20:33:07.321098 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 20:33:07.322343 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:07.322343 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:07.322343 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:07.322343 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:07.322343 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:07.322343 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:07.322343 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:07.322343 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:07.322343 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:07.322343 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:07.322343 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:07.322343 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:07.322343 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:07.322343 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:07.322343 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:07.322343 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:07.322343 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 20:33:07.323406 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 20:33:07.323406 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:33:07.323406 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:33:07.328876 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 238/467] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Oct 1 20:33:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:07.330083 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b066a9-a824-4d2c-8a0b-77ac16eb5f7d None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:07.334904 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 230/468] 10.222.0.23 () {60 vars in 1132 bytes} [Sat Oct 1 20:33:07 2022] POST /identity/v3/users => generated 246 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 20:33:07.335050 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adc5659-73f0-41fd-b224-bb3dcef0daee None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:07.403123 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:07.464053 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b066a9-a824-4d2c-8a0b-77ac16eb5f7d None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:07.467802 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adc5659-73f0-41fd-b224-bb3dcef0daee None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:07.504892 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801bfe50-2122-4a1b-93f1-2954379f95fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:07.505374 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417d90f2-df06-47ec-a6d5-76877934f051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:07.505498 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801bfe50-2122-4a1b-93f1-2954379f95fb None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:07.505818 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801bfe50-2122-4a1b-93f1-2954379f95fb None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:07.505974 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417d90f2-df06-47ec-a6d5-76877934f051 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:07.506078 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801bfe50-2122-4a1b-93f1-2954379f95fb None admin] PATH_INFO: `/v3/domains` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:07.506250 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417d90f2-df06-47ec-a6d5-76877934f051 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:07.506520 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417d90f2-df06-47ec-a6d5-76877934f051 None admin] PATH_INFO: `/v3/domains` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:07.506750 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801bfe50-2122-4a1b-93f1-2954379f95fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:07.507023 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801bfe50-2122-4a1b-93f1-2954379f95fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:07.507182 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417d90f2-df06-47ec-a6d5-76877934f051 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:07.507459 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417d90f2-df06-47ec-a6d5-76877934f051 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:07.508505 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801bfe50-2122-4a1b-93f1-2954379f95fb None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:07.508868 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417d90f2-df06-47ec-a6d5-76877934f051 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:07.522155 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 239/469] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Oct 1 20:33:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:07.523021 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801bfe50-2122-4a1b-93f1-2954379f95fb None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:07.528669 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 231/470] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Oct 1 20:33:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:07.529926 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417d90f2-df06-47ec-a6d5-76877934f051 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:07.538396 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:07.645241 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801bfe50-2122-4a1b-93f1-2954379f95fb None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:07.649000 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417d90f2-df06-47ec-a6d5-76877934f051 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:07.661988 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:07.686422 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d7fade-1701-4ef8-b2e8-ef711d8c6c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:07.687108 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d7fade-1701-4ef8-b2e8-ef711d8c6c3b None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:07.687329 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d7fade-1701-4ef8-b2e8-ef711d8c6c3b None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:07.687600 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d7fade-1701-4ef8-b2e8-ef711d8c6c3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:07.690727 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b408b43-67fa-4a8d-b960-3e2b9f8d569e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:07.691327 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b408b43-67fa-4a8d-b960-3e2b9f8d569e None admin] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:07.691598 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b408b43-67fa-4a8d-b960-3e2b9f8d569e None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:07.691863 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b408b43-67fa-4a8d-b960-3e2b9f8d569e None admin] PATH_INFO: `/v3/users` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:07.692497 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b408b43-67fa-4a8d-b960-3e2b9f8d569e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:07.694227 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b408b43-67fa-4a8d-b960-3e2b9f8d569e None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:07.703162 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d7fade-1701-4ef8-b2e8-ef711d8c6c3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:07.704659 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d7fade-1701-4ef8-b2e8-ef711d8c6c3b None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:07.724550 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 232/471] 10.222.0.23 () {60 vars in 1132 bytes} [Sat Oct 1 20:33:07 2022] POST /identity/v3/users => generated 248 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 01 20:33:07.724550 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b408b43-67fa-4a8d-b960-3e2b9f8d569e None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:07.724821 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-29d7fade-1701-4ef8-b2e8-ef711d8c6c3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:33:07.724821 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:07.724821 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:07.724821 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:07.724821 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:07.724821 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:07.724821 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:07.724821 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:07.724821 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:07.724821 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:07.724821 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:07.724821 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:07.724821 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 20:33:07.724821 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 20:33:07.724821 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 20:33:07.724821 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 20:33:07.725646 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:07.725646 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:07.725646 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:07.725646 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:07.725646 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:07.725646 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:07.725646 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:07.725646 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:07.725646 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:07.725646 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:07.725646 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:07.725646 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:07.725646 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:07.725646 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:07.725646 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:07.725646 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:07.725646 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 20:33:07.726477 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 20:33:07.726477 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:33:07.726477 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:33:07.726477 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 240/472] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Oct 1 20:33:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:07.728595 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d7fade-1701-4ef8-b2e8-ef711d8c6c3b None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:07.816383 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:07.845885 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b408b43-67fa-4a8d-b960-3e2b9f8d569e None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:07.880995 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d7fade-1701-4ef8-b2e8-ef711d8c6c3b None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:07.892737 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6261c12-dc44-4f0e-abb5-bbc68f92530b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:07.893772 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6261c12-dc44-4f0e-abb5-bbc68f92530b None admin] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:07.894324 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6261c12-dc44-4f0e-abb5-bbc68f92530b None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:07.894606 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6261c12-dc44-4f0e-abb5-bbc68f92530b None admin] PATH_INFO: `/v3/users` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:07.895315 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6261c12-dc44-4f0e-abb5-bbc68f92530b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:07.897551 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6261c12-dc44-4f0e-abb5-bbc68f92530b None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:07.924164 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacb1621-dc05-4d7f-928b-3082f8b31be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:07.924876 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb1621-dc05-4d7f-928b-3082f8b31be2 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:07.925359 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb1621-dc05-4d7f-928b-3082f8b31be2 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:07.925525 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb1621-dc05-4d7f-928b-3082f8b31be2 None admin] PATH_INFO: `/v3/domains` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:07.926285 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacb1621-dc05-4d7f-928b-3082f8b31be2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:07.926644 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacb1621-dc05-4d7f-928b-3082f8b31be2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:07.928123 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacb1621-dc05-4d7f-928b-3082f8b31be2 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:07.932677 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 233/473] 10.222.0.23 () {60 vars in 1132 bytes} [Sat Oct 1 20:33:07 2022] POST /identity/v3/users => generated 248 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 20:33:07.951568 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 241/474] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Oct 1 20:33:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 20:33:07.953512 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6261c12-dc44-4f0e-abb5-bbc68f92530b None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:08.003739 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:08.074084 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6261c12-dc44-4f0e-abb5-bbc68f92530b None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:08.117577 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81596691-21d2-4c6d-82d0-98b980f4014f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:08.118199 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81596691-21d2-4c6d-82d0-98b980f4014f None admin] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:08.118524 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81596691-21d2-4c6d-82d0-98b980f4014f None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:08.118794 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81596691-21d2-4c6d-82d0-98b980f4014f None admin] PATH_INFO: `/v3/users` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:08.119507 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81596691-21d2-4c6d-82d0-98b980f4014f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:08.121002 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81596691-21d2-4c6d-82d0-98b980f4014f None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:08.146289 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 234/475] 10.222.0.23 () {60 vars in 1132 bytes} [Sat Oct 1 20:33:07 2022] POST /identity/v3/users => generated 249 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 20:33:09.912558 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66e918b-b26c-4b62-94a2-b70407e2fed3 None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:09.913084 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66e918b-b26c-4b62-94a2-b70407e2fed3 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:09.913084 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66e918b-b26c-4b62-94a2-b70407e2fed3 None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:09.914636 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 242/476] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:33:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:33:09.920803 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3c7251-30f9-4024-93a1-c21581750d24 None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:09.921238 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3c7251-30f9-4024-93a1-c21581750d24 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:09.921405 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3c7251-30f9-4024-93a1-c21581750d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:09.940363 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-bc3c7251-30f9-4024-93a1-c21581750d24 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:33:09.941572 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-bc3c7251-30f9-4024-93a1-c21581750d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:33:10.019838 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 235/477] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:33:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 20:33:10.370191 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66e918b-b26c-4b62-94a2-b70407e2fed3 None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:10.425361 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e766d5d-5f2e-4802-86c0-6adaaa36a2a7 None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:10.425961 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e766d5d-5f2e-4802-86c0-6adaaa36a2a7 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:10.426454 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e766d5d-5f2e-4802-86c0-6adaaa36a2a7 None None] PATH_INFO: `/` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:10.428215 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 236/478] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:33:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:33:10.433457 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df415ed4-be21-459f-a196-168595ed233f None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:10.433817 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df415ed4-be21-459f-a196-168595ed233f None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:10.434165 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df415ed4-be21-459f-a196-168595ed233f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:10.454135 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-df415ed4-be21-459f-a196-168595ed233f None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:33:10.455433 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-df415ed4-be21-459f-a196-168595ed233f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:33:10.457592 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:10.495076 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66e918b-b26c-4b62-94a2-b70407e2fed3 None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:10.520388 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:10.536824 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 237/479] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:33:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 01 20:33:10.544170 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac625bd-9b4f-491b-a92a-ea9e65ce07bf None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:10.544170 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac625bd-9b4f-491b-a92a-ea9e65ce07bf None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:10.544170 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac625bd-9b4f-491b-a92a-ea9e65ce07bf None None] PATH_INFO: `/` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:10.544170 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 238/480] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:33:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:33:10.544414 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7c1b05-565a-4616-8eef-b5a27e53648d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:10.544414 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c1b05-565a-4616-8eef-b5a27e53648d None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:10.544414 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c1b05-565a-4616-8eef-b5a27e53648d None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:10.544414 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c1b05-565a-4616-8eef-b5a27e53648d None admin] PATH_INFO: `/v3/roles/service` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:10.545426 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b38c2d-3166-4da3-a60e-32356e06b3a9 None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:10.548547 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b38c2d-3166-4da3-a60e-32356e06b3a9 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:10.548547 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b38c2d-3166-4da3-a60e-32356e06b3a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:10.553813 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7c1b05-565a-4616-8eef-b5a27e53648d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 20:33:10.558606 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-9e7c1b05-565a-4616-8eef-b5a27e53648d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 01 20:33:10.558606 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:10.558606 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:10.558606 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:10.558606 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:10.558606 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:10.558606 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:10.558606 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:10.558606 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:10.558606 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:10.558606 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:10.558606 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:10.558606 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 20:33:10.558606 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 20:33:10.558606 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 20:33:10.558606 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 20:33:10.559517 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 20:33:10.559517 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 20:33:10.559517 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 20:33:10.559517 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 20:33:10.559517 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:10.559517 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:10.559517 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:10.559517 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:10.559517 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:10.559517 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:10.559517 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:10.559517 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:10.559517 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:10.559517 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:10.559517 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:10.559517 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:10.560319 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:10.560319 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:10.560319 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:10.560319 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:10.560319 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 20:33:10.560319 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 20:33:10.560319 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 20:33:10.560319 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 20:33:10.560319 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 20:33:10.560319 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 20:33:10.560319 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 01 20:33:10.560319 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:33:10.560319 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 243/481] 10.222.0.23 () {56 vars in 1102 bytes} [Sat Oct 1 20:33:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:10.565544 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7c1b05-565a-4616-8eef-b5a27e53648d None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:10.570118 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-37b38c2d-3166-4da3-a60e-32356e06b3a9 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:33:10.571320 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-37b38c2d-3166-4da3-a60e-32356e06b3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:33:10.653238 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 239/482] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:33:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 01 20:33:10.655131 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac1528d-0395-4dba-9605-340c420cb481 None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:10.655425 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac1528d-0395-4dba-9605-340c420cb481 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:10.655701 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac1528d-0395-4dba-9605-340c420cb481 None None] PATH_INFO: `/` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:10.657394 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 240/483] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:33:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:33:10.662988 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec83c9a4-0d0d-4b20-b454-17b298da3100 None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:10.663379 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec83c9a4-0d0d-4b20-b454-17b298da3100 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:10.663751 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec83c9a4-0d0d-4b20-b454-17b298da3100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:10.681703 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7c1b05-565a-4616-8eef-b5a27e53648d None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:10.689548 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-ec83c9a4-0d0d-4b20-b454-17b298da3100 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:33:10.691474 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-ec83c9a4-0d0d-4b20-b454-17b298da3100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:33:10.722679 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837b9123-8200-4123-8b9c-be0ad631f1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:10.723649 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837b9123-8200-4123-8b9c-be0ad631f1dd None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:10.724063 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837b9123-8200-4123-8b9c-be0ad631f1dd None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:10.724472 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837b9123-8200-4123-8b9c-be0ad631f1dd None admin] PATH_INFO: `/v3/roles` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:10.725285 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837b9123-8200-4123-8b9c-be0ad631f1dd None admin] RBAC: Adding query filter params (name=service) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:10.725721 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837b9123-8200-4123-8b9c-be0ad631f1dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:10.727422 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837b9123-8200-4123-8b9c-be0ad631f1dd None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:10.736883 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 244/484] 10.222.0.23 () {56 vars in 1103 bytes} [Sat Oct 1 20:33:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 20:33:10.742686 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837b9123-8200-4123-8b9c-be0ad631f1dd None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:10.772616 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:10.788831 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 241/485] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:33:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 01 20:33:10.795532 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:10.856147 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837b9123-8200-4123-8b9c-be0ad631f1dd None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:10.880326 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec83c9a4-0d0d-4b20-b454-17b298da3100 None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:10.895402 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb824003-6f20-4cf6-be32-c325e78e0da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:10.896192 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb824003-6f20-4cf6-be32-c325e78e0da4 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:10.896465 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb824003-6f20-4cf6-be32-c325e78e0da4 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:10.897135 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb824003-6f20-4cf6-be32-c325e78e0da4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:10.911687 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb824003-6f20-4cf6-be32-c325e78e0da4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:10.913609 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb824003-6f20-4cf6-be32-c325e78e0da4 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:10.935451 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-fb824003-6f20-4cf6-be32-c325e78e0da4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:33:10.935451 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:10.935451 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:10.935451 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:10.935451 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:10.935451 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:10.935451 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:10.935451 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:10.935451 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:10.935451 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:10.935451 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:10.935451 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:10.935451 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 20:33:10.935451 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 20:33:10.935451 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 20:33:10.935451 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 20:33:10.936400 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:10.936400 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:10.936400 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:10.936400 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:10.936400 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:10.936400 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:10.936400 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:10.936400 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:10.936400 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:10.936400 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:10.936400 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:10.936400 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:10.936400 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:10.936400 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:10.936400 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:10.936400 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:10.936400 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 20:33:10.937754 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 20:33:10.937754 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:33:10.937754 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:33:10.937754 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 245/486] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Oct 1 20:33:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:10.945195 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb824003-6f20-4cf6-be32-c325e78e0da4 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:10.995915 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec83c9a4-0d0d-4b20-b454-17b298da3100 None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:11.033153 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa02054-1115-4b0a-9727-fd540ad1274a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:11.033783 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa02054-1115-4b0a-9727-fd540ad1274a None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:11.034055 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa02054-1115-4b0a-9727-fd540ad1274a None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:11.034321 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa02054-1115-4b0a-9727-fd540ad1274a None admin] PATH_INFO: `/v3/roles/service` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:11.044462 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa02054-1115-4b0a-9727-fd540ad1274a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 20:33:11.050119 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application [None req-2aa02054-1115-4b0a-9727-fd540ad1274a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 01 20:33:11.050119 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:11.050119 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:11.050119 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:11.050119 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:11.050119 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:11.050119 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:11.050119 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:11.050119 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:11.050119 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:11.050119 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:11.050119 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:11.050119 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 20:33:11.050119 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 20:33:11.050119 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 20:33:11.050119 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 20:33:11.051025 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 20:33:11.051025 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 20:33:11.051025 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 20:33:11.051025 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 20:33:11.051025 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:11.051025 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:11.051025 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:11.051025 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:11.051025 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:11.051025 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:11.051025 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:11.051025 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:11.051025 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:11.051025 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:11.051025 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:11.051025 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:11.051857 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:11.051857 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:11.051857 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:11.051857 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:11.051857 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 20:33:11.051857 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 20:33:11.051857 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 20:33:11.051857 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 20:33:11.051857 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 20:33:11.051857 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 20:33:11.051857 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 01 20:33:11.051857 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:33:11.051857 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 242/487] 10.222.0.23 () {56 vars in 1102 bytes} [Sat Oct 1 20:33:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:11.052556 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa02054-1115-4b0a-9727-fd540ad1274a None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:11.059507 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:11.066873 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb824003-6f20-4cf6-be32-c325e78e0da4 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:11.105229 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76cfe14-3099-498e-8864-56322fc9730a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:11.105824 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76cfe14-3099-498e-8864-56322fc9730a None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:11.106088 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76cfe14-3099-498e-8864-56322fc9730a None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:11.106616 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76cfe14-3099-498e-8864-56322fc9730a None admin] PATH_INFO: `/v3/domains` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:11.106970 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76cfe14-3099-498e-8864-56322fc9730a None admin] RBAC: Adding query filter params (name=Default) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:11.107314 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76cfe14-3099-498e-8864-56322fc9730a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:11.109231 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76cfe14-3099-498e-8864-56322fc9730a None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:11.112982 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:11.125979 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 246/488] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Oct 1 20:33:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:11.125979 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76cfe14-3099-498e-8864-56322fc9730a None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:11.162039 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa02054-1115-4b0a-9727-fd540ad1274a None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:11.200499 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb64f92a-c9e8-4ed1-99a2-01c559400dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:11.201263 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb64f92a-c9e8-4ed1-99a2-01c559400dfd None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:11.201547 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb64f92a-c9e8-4ed1-99a2-01c559400dfd None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:11.201822 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb64f92a-c9e8-4ed1-99a2-01c559400dfd None admin] PATH_INFO: `/v3/roles/service` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:11.211735 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb64f92a-c9e8-4ed1-99a2-01c559400dfd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 20:33:11.216515 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application [None req-fb64f92a-c9e8-4ed1-99a2-01c559400dfd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 01 20:33:11.216515 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:11.216515 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:11.216515 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:11.216515 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:11.216515 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:11.216515 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:11.216515 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:11.216515 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:11.216515 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:11.216515 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:11.216515 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:11.216515 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 20:33:11.216515 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 20:33:11.216515 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 20:33:11.216515 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 20:33:11.218102 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 20:33:11.218102 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 20:33:11.218102 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 20:33:11.218102 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 20:33:11.218102 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:11.218102 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:11.218102 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:11.218102 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:11.218102 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:11.218102 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:11.218102 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:11.218102 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:11.218102 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:11.218102 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:11.218102 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:11.218102 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:11.218921 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:11.218921 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:11.218921 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:11.218921 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:11.218921 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 20:33:11.218921 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 20:33:11.218921 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 20:33:11.218921 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 20:33:11.218921 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 20:33:11.218921 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 20:33:11.218921 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 01 20:33:11.218921 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:33:11.218921 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 243/489] 10.222.0.23 () {56 vars in 1102 bytes} [Sat Oct 1 20:33:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:11.219578 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb64f92a-c9e8-4ed1-99a2-01c559400dfd None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:11.228344 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76cfe14-3099-498e-8864-56322fc9730a None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:11.265025 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8d826e-1a7f-4da2-a08b-44a492827894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:11.265620 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8d826e-1a7f-4da2-a08b-44a492827894 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:11.265957 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8d826e-1a7f-4da2-a08b-44a492827894 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:11.266227 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8d826e-1a7f-4da2-a08b-44a492827894 None admin] PATH_INFO: `/v3/roles` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:11.266883 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8d826e-1a7f-4da2-a08b-44a492827894 None admin] RBAC: Adding query filter params (name=service) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:11.267178 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8d826e-1a7f-4da2-a08b-44a492827894 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:11.268541 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8d826e-1a7f-4da2-a08b-44a492827894 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:11.277911 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 247/490] 10.222.0.23 () {56 vars in 1103 bytes} [Sat Oct 1 20:33:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:11.283645 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8d826e-1a7f-4da2-a08b-44a492827894 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:11.304487 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:11.329281 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb64f92a-c9e8-4ed1-99a2-01c559400dfd None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:11.346679 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:11.363547 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6264f351-c094-43e7-ae67-3ca98dd676e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:11.364170 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6264f351-c094-43e7-ae67-3ca98dd676e3 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:11.364449 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6264f351-c094-43e7-ae67-3ca98dd676e3 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:11.364750 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6264f351-c094-43e7-ae67-3ca98dd676e3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:11.372096 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6264f351-c094-43e7-ae67-3ca98dd676e3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:11.373624 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6264f351-c094-43e7-ae67-3ca98dd676e3 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:11.386395 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application [None req-6264f351-c094-43e7-ae67-3ca98dd676e3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 01 20:33:11.386395 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:11.386395 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:11.386395 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:11.386395 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:11.386395 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:11.386395 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:11.386395 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:11.386395 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:11.386395 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:11.386395 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:11.386395 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:11.386395 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 01 20:33:11.386395 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 01 20:33:11.386395 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 01 20:33:11.386395 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 01 20:33:11.387476 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:11.387476 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:11.387476 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 01 20:33:11.387476 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 20:33:11.387476 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 01 20:33:11.387476 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 20:33:11.387476 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:11.387476 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:11.387476 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:11.387476 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:11.387476 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:11.387476 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:11.387476 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:11.387476 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:11.387476 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:11.387476 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:11.387476 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:11.387476 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:11.388411 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:11.388411 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:11.388411 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 01 20:33:11.388411 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 01 20:33:11.388411 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 01 20:33:11.388411 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 01 20:33:11.388411 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 01 20:33:11.388411 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 01 20:33:11.388411 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 01 20:33:11.388411 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:33:11.391756 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8d826e-1a7f-4da2-a08b-44a492827894 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:11.392798 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 244/491] 10.222.0.23 () {56 vars in 1093 bytes} [Sat Oct 1 20:33:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:11.393681 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6264f351-c094-43e7-ae67-3ca98dd676e3 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:11.422258 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70c7651-ca5e-4575-b007-b0eeee269dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:11.422888 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70c7651-ca5e-4575-b007-b0eeee269dbe None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:11.423158 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70c7651-ca5e-4575-b007-b0eeee269dbe None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:11.423427 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70c7651-ca5e-4575-b007-b0eeee269dbe None admin] PATH_INFO: `/v3/roles/service` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:11.433439 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70c7651-ca5e-4575-b007-b0eeee269dbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 20:33:11.438684 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-f70c7651-ca5e-4575-b007-b0eeee269dbe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 01 20:33:11.438684 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:11.438684 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:11.438684 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:11.438684 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:11.438684 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:11.438684 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:11.438684 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:11.438684 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:11.438684 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:11.438684 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:11.438684 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:11.438684 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 20:33:11.438684 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 20:33:11.438684 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 20:33:11.438684 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 20:33:11.439597 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 20:33:11.439597 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 20:33:11.439597 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 20:33:11.439597 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 20:33:11.439597 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:11.439597 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:11.439597 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:11.439597 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:11.439597 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:11.439597 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:11.439597 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:11.439597 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:11.439597 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:11.439597 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:11.439597 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:11.439597 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:11.440392 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:11.440392 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:11.440392 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:11.440392 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:11.440392 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 20:33:11.440392 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 20:33:11.440392 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 20:33:11.440392 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 20:33:11.440392 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 20:33:11.440392 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 20:33:11.440392 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 01 20:33:11.440392 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:33:11.440392 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 248/492] 10.222.0.23 () {56 vars in 1102 bytes} [Sat Oct 1 20:33:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:11.441361 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70c7651-ca5e-4575-b007-b0eeee269dbe None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:11.496299 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6264f351-c094-43e7-ae67-3ca98dd676e3 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:11.515955 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:11.529862 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ff6c68-6222-4dd6-af04-7014e7042c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:11.530462 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ff6c68-6222-4dd6-af04-7014e7042c7d None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:11.530741 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ff6c68-6222-4dd6-af04-7014e7042c7d None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:11.531012 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ff6c68-6222-4dd6-af04-7014e7042c7d None admin] PATH_INFO: `/v3/roles` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:11.531666 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ff6c68-6222-4dd6-af04-7014e7042c7d None admin] RBAC: Adding query filter params (name=service) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:11.531971 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ff6c68-6222-4dd6-af04-7014e7042c7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:11.533418 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ff6c68-6222-4dd6-af04-7014e7042c7d None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:11.539306 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70c7651-ca5e-4575-b007-b0eeee269dbe None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:11.541138 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 245/493] 10.222.0.23 () {56 vars in 1103 bytes} [Sat Oct 1 20:33:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:11.541915 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ff6c68-6222-4dd6-af04-7014e7042c7d None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:11.573838 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca60d21-877b-4800-9bb8-55a56025d912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:11.574700 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca60d21-877b-4800-9bb8-55a56025d912 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:11.574973 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca60d21-877b-4800-9bb8-55a56025d912 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:11.575242 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca60d21-877b-4800-9bb8-55a56025d912 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:11.585933 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:11.586896 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca60d21-877b-4800-9bb8-55a56025d912 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:11.588360 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca60d21-877b-4800-9bb8-55a56025d912 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:11.610073 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-7ca60d21-877b-4800-9bb8-55a56025d912 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:33:11.610073 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:11.610073 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:11.610073 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:11.610073 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:11.610073 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:11.610073 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:11.610073 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:11.610073 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:11.610073 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:11.610073 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:11.610073 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:11.610073 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 20:33:11.610073 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 20:33:11.610073 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 20:33:11.610073 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 20:33:11.611040 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:11.611040 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:11.611040 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:11.611040 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:11.611040 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:11.611040 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:11.611040 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:11.611040 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:11.611040 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:11.611040 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:11.611040 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:11.611040 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:11.611040 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:11.611040 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:11.611040 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:11.611040 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:11.611040 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 20:33:11.611906 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 20:33:11.611906 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:33:11.611906 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:33:11.611906 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 249/494] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Oct 1 20:33:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:11.614722 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca60d21-877b-4800-9bb8-55a56025d912 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:11.649003 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ff6c68-6222-4dd6-af04-7014e7042c7d None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:11.681510 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d688559b-5515-424e-856e-c70712b92dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:11.682107 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d688559b-5515-424e-856e-c70712b92dfb None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:11.682379 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d688559b-5515-424e-856e-c70712b92dfb None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:11.682645 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d688559b-5515-424e-856e-c70712b92dfb None admin] PATH_INFO: `/v3/users` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:11.683351 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d688559b-5515-424e-856e-c70712b92dfb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:11.683646 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d688559b-5515-424e-856e-c70712b92dfb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:11.685107 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d688559b-5515-424e-856e-c70712b92dfb None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:11.716719 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca60d21-877b-4800-9bb8-55a56025d912 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:11.721652 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 246/495] 10.222.0.23 () {56 vars in 1133 bytes} [Sat Oct 1 20:33:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:11.722469 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d688559b-5515-424e-856e-c70712b92dfb None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:11.746609 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:11.755323 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e9e98-f18a-4168-b7fa-00cb0503e9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:11.755917 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e9e98-f18a-4168-b7fa-00cb0503e9bc None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:11.756189 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e9e98-f18a-4168-b7fa-00cb0503e9bc None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:11.756460 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e9e98-f18a-4168-b7fa-00cb0503e9bc None admin] PATH_INFO: `/v3/roles` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:11.757142 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08e9e98-f18a-4168-b7fa-00cb0503e9bc None admin] RBAC: Adding query filter params (name=service) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:11.757440 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08e9e98-f18a-4168-b7fa-00cb0503e9bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:11.758808 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08e9e98-f18a-4168-b7fa-00cb0503e9bc None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:11.766661 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 250/496] 10.222.0.23 () {56 vars in 1103 bytes} [Sat Oct 1 20:33:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:11.767436 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e9e98-f18a-4168-b7fa-00cb0503e9bc None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:11.824401 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:11.829551 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d688559b-5515-424e-856e-c70712b92dfb None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:11.863161 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d74a17d-8186-4b49-b65f-75ad26bdd84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:11.863781 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d74a17d-8186-4b49-b65f-75ad26bdd84a None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:11.864055 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d74a17d-8186-4b49-b65f-75ad26bdd84a None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:11.864322 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d74a17d-8186-4b49-b65f-75ad26bdd84a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:11.865327 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e9e98-f18a-4168-b7fa-00cb0503e9bc None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:11.874817 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d74a17d-8186-4b49-b65f-75ad26bdd84a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:11.876288 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d74a17d-8186-4b49-b65f-75ad26bdd84a None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:11.892399 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application [None req-5d74a17d-8186-4b49-b65f-75ad26bdd84a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:33:11.892399 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:11.892399 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:11.892399 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:11.892399 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:11.892399 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:11.892399 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:11.892399 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:11.892399 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:11.892399 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:11.892399 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:11.892399 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:11.892399 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 20:33:11.892399 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 20:33:11.892399 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 20:33:11.892399 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 20:33:11.893500 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:11.893500 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:11.893500 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:11.893500 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:11.893500 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:11.893500 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:11.893500 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:11.893500 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:11.893500 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:11.893500 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:11.893500 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:11.893500 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:11.893500 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:11.893500 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:11.893500 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:11.893500 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:11.893500 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 20:33:11.894676 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 20:33:11.894676 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:33:11.894676 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:33:11.894676 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 247/497] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Oct 1 20:33:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:11.894676 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d74a17d-8186-4b49-b65f-75ad26bdd84a None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:11.903525 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373798f9-ad7d-41c0-8b15-d07412fa7bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:11.904153 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373798f9-ad7d-41c0-8b15-d07412fa7bc2 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:11.904547 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373798f9-ad7d-41c0-8b15-d07412fa7bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:11.905055 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373798f9-ad7d-41c0-8b15-d07412fa7bc2 None admin] PATH_INFO: `/v3/domains` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:11.905784 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373798f9-ad7d-41c0-8b15-d07412fa7bc2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:11.906086 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373798f9-ad7d-41c0-8b15-d07412fa7bc2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:11.907445 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373798f9-ad7d-41c0-8b15-d07412fa7bc2 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:11.924820 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 251/498] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Oct 1 20:33:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:11.924820 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373798f9-ad7d-41c0-8b15-d07412fa7bc2 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:11.971520 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:11.999056 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d74a17d-8186-4b49-b65f-75ad26bdd84a None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:12.021822 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373798f9-ad7d-41c0-8b15-d07412fa7bc2 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:12.032372 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a07f777-967c-4921-a537-b19661998109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:12.033024 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07f777-967c-4921-a537-b19661998109 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:12.033298 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07f777-967c-4921-a537-b19661998109 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:12.033586 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07f777-967c-4921-a537-b19661998109 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:12.052553 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:12.056226 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25674331-596a-460a-a278-ce8bed0f291d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:12.056871 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25674331-596a-460a-a278-ce8bed0f291d None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:12.057156 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25674331-596a-460a-a278-ce8bed0f291d None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:12.057428 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25674331-596a-460a-a278-ce8bed0f291d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:12.067265 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25674331-596a-460a-a278-ce8bed0f291d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:12.069013 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25674331-596a-460a-a278-ce8bed0f291d None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:12.083779 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-25674331-596a-460a-a278-ce8bed0f291d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:33:12.083779 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:12.083779 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:12.083779 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:12.083779 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:12.083779 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:12.083779 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:12.083779 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:12.083779 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:12.083779 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:12.083779 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:12.083779 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:12.083779 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 20:33:12.083779 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 20:33:12.083779 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 20:33:12.083779 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 20:33:12.084726 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:12.084726 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:12.084726 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:12.084726 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:12.084726 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:12.084726 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:12.084726 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:12.084726 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:12.084726 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:12.084726 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:12.084726 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:12.084726 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:12.084726 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:12.084726 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:12.084726 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:12.084726 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:12.084726 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 20:33:12.085560 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 20:33:12.085560 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:33:12.085560 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:33:12.085560 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 252/499] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Oct 1 20:33:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:12.085784 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25674331-596a-460a-a278-ce8bed0f291d None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:12.102401 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a07f777-967c-4921-a537-b19661998109 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:12.103871 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a07f777-967c-4921-a537-b19661998109 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:12.187103 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25674331-596a-460a-a278-ce8bed0f291d None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:12.188771 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:12.202971 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 248/500] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Oct 1 20:33:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 01 20:33:12.203808 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a07f777-967c-4921-a537-b19661998109 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:12.222999 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edf029b-65bb-4a78-a707-272529dbfb82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:12.223597 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf029b-65bb-4a78-a707-272529dbfb82 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:12.223873 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf029b-65bb-4a78-a707-272529dbfb82 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:12.224143 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf029b-65bb-4a78-a707-272529dbfb82 None admin] PATH_INFO: `/v3/domains` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:12.224806 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edf029b-65bb-4a78-a707-272529dbfb82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:12.225099 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edf029b-65bb-4a78-a707-272529dbfb82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:12.226505 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edf029b-65bb-4a78-a707-272529dbfb82 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:12.237904 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 253/501] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Oct 1 20:33:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:12.238689 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edf029b-65bb-4a78-a707-272529dbfb82 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:12.257873 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:12.308115 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a07f777-967c-4921-a537-b19661998109 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:12.336598 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edf029b-65bb-4a78-a707-272529dbfb82 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:12.340964 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccb6dfb-1f72-4f9f-92cb-464df2fc7aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:12.341646 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb6dfb-1f72-4f9f-92cb-464df2fc7aad None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:12.341923 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb6dfb-1f72-4f9f-92cb-464df2fc7aad None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:12.342180 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb6dfb-1f72-4f9f-92cb-464df2fc7aad None admin] PATH_INFO: `/v3/users/cinder` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:12.349167 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccb6dfb-1f72-4f9f-92cb-464df2fc7aad None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:12.350609 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccb6dfb-1f72-4f9f-92cb-464df2fc7aad None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:12.362299 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application [None req-5ccb6dfb-1f72-4f9f-92cb-464df2fc7aad None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 01 20:33:12.362299 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:12.362299 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:12.362299 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:12.362299 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:12.362299 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:12.362299 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:12.362299 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:12.362299 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:12.362299 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:12.362299 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:12.362299 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:12.362299 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 01 20:33:12.362299 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 01 20:33:12.362299 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 01 20:33:12.362299 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 01 20:33:12.363214 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:12.363214 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:12.363214 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 01 20:33:12.363214 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 20:33:12.363214 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 01 20:33:12.363214 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 20:33:12.363214 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:12.363214 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:12.363214 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:12.363214 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:12.363214 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:12.363214 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:12.363214 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:12.363214 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:12.363214 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:12.363214 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:12.363214 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:12.363214 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:12.364102 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:12.364102 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:12.364102 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 01 20:33:12.364102 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 01 20:33:12.364102 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 01 20:33:12.364102 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 01 20:33:12.364102 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 01 20:33:12.364102 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 01 20:33:12.364102 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 01 20:33:12.364102 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:33:12.364102 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 249/502] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Oct 1 20:33:12 2022] GET /identity/v3/users/cinder => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:12.364718 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccb6dfb-1f72-4f9f-92cb-464df2fc7aad None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:12.373911 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f563710a-e0e6-4061-a44a-bcc23ce41b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:12.374565 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563710a-e0e6-4061-a44a-bcc23ce41b6c None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:12.374846 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563710a-e0e6-4061-a44a-bcc23ce41b6c None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:12.375119 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563710a-e0e6-4061-a44a-bcc23ce41b6c None admin] PATH_INFO: `/v3/domains` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:12.375758 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f563710a-e0e6-4061-a44a-bcc23ce41b6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:12.376059 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f563710a-e0e6-4061-a44a-bcc23ce41b6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:12.377466 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f563710a-e0e6-4061-a44a-bcc23ce41b6c None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:12.389092 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 254/503] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Oct 1 20:33:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:12.389881 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f563710a-e0e6-4061-a44a-bcc23ce41b6c None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:12.417053 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:12.465621 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccb6dfb-1f72-4f9f-92cb-464df2fc7aad None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:12.476327 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:12.492711 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f563710a-e0e6-4061-a44a-bcc23ce41b6c None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:12.500501 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c6ad9-8774-4bea-8523-199f623f0ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:12.501160 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c6ad9-8774-4bea-8523-199f623f0ce3 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:12.501438 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c6ad9-8774-4bea-8523-199f623f0ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:12.501712 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c6ad9-8774-4bea-8523-199f623f0ce3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:12.511952 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7c6ad9-8774-4bea-8523-199f623f0ce3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:12.513417 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7c6ad9-8774-4bea-8523-199f623f0ce3 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:12.525686 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ba5527-5318-4113-b340-a37cc50842dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:12.526293 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba5527-5318-4113-b340-a37cc50842dc None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:12.526563 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba5527-5318-4113-b340-a37cc50842dc None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:12.526828 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba5527-5318-4113-b340-a37cc50842dc None admin] PATH_INFO: `/v3/users/glance` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:12.527269 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application [None req-da7c6ad9-8774-4bea-8523-199f623f0ce3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:33:12.527269 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:12.527269 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:12.527269 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:12.527269 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:12.527269 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:12.527269 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:12.527269 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:12.527269 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:12.527269 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:12.527269 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:12.527269 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:12.527269 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 20:33:12.527269 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 20:33:12.527269 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 20:33:12.527269 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 20:33:12.528126 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:12.528126 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:12.528126 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:12.528126 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:12.528126 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:12.528126 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:12.528126 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:12.528126 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:12.528126 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:12.528126 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:12.528126 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:12.528126 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:12.528126 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:12.528126 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:12.528126 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:12.528126 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:12.528126 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 20:33:12.529542 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 20:33:12.529542 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:33:12.529542 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:33:12.529542 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 250/504] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Oct 1 20:33:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:12.529776 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c6ad9-8774-4bea-8523-199f623f0ce3 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:12.535484 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ba5527-5318-4113-b340-a37cc50842dc None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:12.536952 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ba5527-5318-4113-b340-a37cc50842dc None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:12.550122 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-54ba5527-5318-4113-b340-a37cc50842dc None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 01 20:33:12.550122 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:12.550122 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:12.550122 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:12.550122 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:12.550122 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:12.550122 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:12.550122 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:12.550122 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:12.550122 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:12.550122 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:12.550122 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:12.550122 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 01 20:33:12.550122 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 01 20:33:12.550122 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 01 20:33:12.550122 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 01 20:33:12.551027 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:12.551027 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:12.551027 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 01 20:33:12.551027 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 20:33:12.551027 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 01 20:33:12.551027 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 20:33:12.551027 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:12.551027 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:12.551027 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:12.551027 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:12.551027 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:12.551027 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:12.551027 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:12.551027 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:12.551027 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:12.551027 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:12.551027 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:12.551027 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:12.551917 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:12.551917 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:12.551917 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 01 20:33:12.551917 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 01 20:33:12.551917 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 01 20:33:12.551917 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 01 20:33:12.551917 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 01 20:33:12.551917 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 01 20:33:12.551917 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 01 20:33:12.551917 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:33:12.551917 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 255/505] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Oct 1 20:33:12 2022] GET /identity/v3/users/glance => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:12.551917 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ba5527-5318-4113-b340-a37cc50842dc None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:12.633905 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c6ad9-8774-4bea-8523-199f623f0ce3 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:12.635958 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:12.653953 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ba5527-5318-4113-b340-a37cc50842dc None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:12.667318 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e4e01b-8c84-4def-8a62-5d425ed0c12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:12.667920 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e4e01b-8c84-4def-8a62-5d425ed0c12a None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:12.668196 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e4e01b-8c84-4def-8a62-5d425ed0c12a None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:12.668459 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e4e01b-8c84-4def-8a62-5d425ed0c12a None admin] PATH_INFO: `/v3/users` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:12.669203 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e4e01b-8c84-4def-8a62-5d425ed0c12a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:12.669502 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e4e01b-8c84-4def-8a62-5d425ed0c12a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:12.671174 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e4e01b-8c84-4def-8a62-5d425ed0c12a None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:12.687536 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d35211-d22c-4a73-a8c7-322947f662f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:12.688153 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d35211-d22c-4a73-a8c7-322947f662f8 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:12.688434 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d35211-d22c-4a73-a8c7-322947f662f8 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:12.688672 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 251/506] 10.222.0.23 () {56 vars in 1137 bytes} [Sat Oct 1 20:33:12 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:12.688762 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d35211-d22c-4a73-a8c7-322947f662f8 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:12.689463 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e4e01b-8c84-4def-8a62-5d425ed0c12a None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:12.697043 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d35211-d22c-4a73-a8c7-322947f662f8 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:12.698500 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d35211-d22c-4a73-a8c7-322947f662f8 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:12.709681 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-e5d35211-d22c-4a73-a8c7-322947f662f8 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 01 20:33:12.709681 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:12.709681 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:12.709681 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:12.709681 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:12.709681 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:12.709681 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:12.709681 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:12.709681 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:12.709681 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:12.709681 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:12.709681 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:12.709681 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 01 20:33:12.709681 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 01 20:33:12.709681 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 01 20:33:12.709681 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 01 20:33:12.710761 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:12.710761 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:12.710761 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 01 20:33:12.710761 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 20:33:12.710761 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 01 20:33:12.710761 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 20:33:12.710761 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:12.710761 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:12.710761 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:12.710761 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:12.710761 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:12.710761 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:12.710761 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:12.710761 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:12.710761 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:12.710761 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:12.710761 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:12.710761 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:12.716421 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:12.716421 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:12.716421 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 01 20:33:12.716421 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 01 20:33:12.716421 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 01 20:33:12.716421 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 01 20:33:12.716421 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 01 20:33:12.716421 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 01 20:33:12.716421 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 01 20:33:12.716421 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:33:12.716421 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 256/507] 10.222.0.23 () {56 vars in 1102 bytes} [Sat Oct 1 20:33:12 2022] GET /identity/v3/users/neutron => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:12.716421 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d35211-d22c-4a73-a8c7-322947f662f8 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:12.718024 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:12.799434 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e4e01b-8c84-4def-8a62-5d425ed0c12a None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:12.814741 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d35211-d22c-4a73-a8c7-322947f662f8 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:12.833017 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6f081e-88f7-459f-81eb-f8b710589994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:12.833637 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f081e-88f7-459f-81eb-f8b710589994 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:12.833910 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f081e-88f7-459f-81eb-f8b710589994 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:12.834174 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f081e-88f7-459f-81eb-f8b710589994 None admin] PATH_INFO: `/v3/domains` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:12.834798 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6f081e-88f7-459f-81eb-f8b710589994 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:12.835091 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6f081e-88f7-459f-81eb-f8b710589994 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:12.836452 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6f081e-88f7-459f-81eb-f8b710589994 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:12.847859 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 252/508] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Oct 1 20:33:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:12.848616 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6f081e-88f7-459f-81eb-f8b710589994 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:12.852509 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b1869b-676d-4cfb-9b8e-ec6fd981a6e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:12.853912 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b1869b-676d-4cfb-9b8e-ec6fd981a6e4 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:12.854204 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b1869b-676d-4cfb-9b8e-ec6fd981a6e4 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:12.854477 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b1869b-676d-4cfb-9b8e-ec6fd981a6e4 None admin] PATH_INFO: `/v3/users` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:12.855202 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b1869b-676d-4cfb-9b8e-ec6fd981a6e4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:12.855507 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b1869b-676d-4cfb-9b8e-ec6fd981a6e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:12.856978 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b1869b-676d-4cfb-9b8e-ec6fd981a6e4 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:12.891499 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:12.895720 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 257/509] 10.222.0.23 () {56 vars in 1137 bytes} [Sat Oct 1 20:33:12 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:12.896625 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b1869b-676d-4cfb-9b8e-ec6fd981a6e4 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:12.934540 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:12.958966 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6f081e-88f7-459f-81eb-f8b710589994 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:12.993025 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b4673-a7ec-4b1c-852b-48a0bc2d92a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:12.993896 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b4673-a7ec-4b1c-852b-48a0bc2d92a5 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:12.994178 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b4673-a7ec-4b1c-852b-48a0bc2d92a5 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:12.994450 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b4673-a7ec-4b1c-852b-48a0bc2d92a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:13.001904 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b1869b-676d-4cfb-9b8e-ec6fd981a6e4 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:13.036138 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2c7426-cb48-4c52-b16c-a699082b55e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:13.036758 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c7426-cb48-4c52-b16c-a699082b55e6 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:13.037027 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c7426-cb48-4c52-b16c-a699082b55e6 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:13.037291 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c7426-cb48-4c52-b16c-a699082b55e6 None admin] PATH_INFO: `/v3/users` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:13.038001 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2c7426-cb48-4c52-b16c-a699082b55e6 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:13.038299 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2c7426-cb48-4c52-b16c-a699082b55e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:13.039715 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2c7426-cb48-4c52-b16c-a699082b55e6 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:13.057973 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 258/510] 10.222.0.23 () {56 vars in 1139 bytes} [Sat Oct 1 20:33:12 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:13.059116 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2c7426-cb48-4c52-b16c-a699082b55e6 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:13.062085 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1b4673-a7ec-4b1c-852b-48a0bc2d92a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:13.063557 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1b4673-a7ec-4b1c-852b-48a0bc2d92a5 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:13.117740 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:13.143949 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:13.159615 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2c7426-cb48-4c52-b16c-a699082b55e6 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:13.167165 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 253/511] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Oct 1 20:33:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 01 20:33:13.167876 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b4673-a7ec-4b1c-852b-48a0bc2d92a5 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:13.196936 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a843d5dd-7801-4506-9fb9-f0beb587a0e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:13.197589 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843d5dd-7801-4506-9fb9-f0beb587a0e3 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:13.197882 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843d5dd-7801-4506-9fb9-f0beb587a0e3 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:13.198148 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843d5dd-7801-4506-9fb9-f0beb587a0e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:13.205957 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a843d5dd-7801-4506-9fb9-f0beb587a0e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:13.207408 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a843d5dd-7801-4506-9fb9-f0beb587a0e3 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:13.219369 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-a843d5dd-7801-4506-9fb9-f0beb587a0e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 20:33:13.219369 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:13.219369 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:13.219369 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:13.219369 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:13.219369 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:13.219369 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:13.219369 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:13.219369 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:13.219369 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:13.219369 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:13.219369 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:13.219369 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 01 20:33:13.219369 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 01 20:33:13.219369 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 01 20:33:13.220223 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 01 20:33:13.220223 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:13.220223 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:13.220223 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:13.220223 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:13.220223 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:13.220223 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:13.220223 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:13.220223 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:13.220223 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:13.220223 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:13.220223 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:13.220223 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:13.220223 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:13.220223 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:13.220223 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:13.220223 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:13.221121 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 01 20:33:13.221121 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 01 20:33:13.221121 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 01 20:33:13.221121 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 01 20:33:13.221121 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 01 20:33:13.221121 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 01 20:33:13.221121 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 20:33:13.221121 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:33:13.221121 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 259/512] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Oct 1 20:33:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:13.221598 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a843d5dd-7801-4506-9fb9-f0beb587a0e3 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:13.274020 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b4673-a7ec-4b1c-852b-48a0bc2d92a5 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:13.312719 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bf375c-57c9-4ae8-bb18-ee800cfa4993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:13.313624 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf375c-57c9-4ae8-bb18-ee800cfa4993 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:13.313910 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf375c-57c9-4ae8-bb18-ee800cfa4993 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:13.314185 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf375c-57c9-4ae8-bb18-ee800cfa4993 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:13.324221 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a843d5dd-7801-4506-9fb9-f0beb587a0e3 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:13.341851 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:13.358554 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948bdf7f-f3f5-47f6-aa56-98adf2dac6c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:13.359147 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948bdf7f-f3f5-47f6-aa56-98adf2dac6c1 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:13.359450 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948bdf7f-f3f5-47f6-aa56-98adf2dac6c1 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:13.359719 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948bdf7f-f3f5-47f6-aa56-98adf2dac6c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:13.364809 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:13.385092 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bf375c-57c9-4ae8-bb18-ee800cfa4993 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:13.386555 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bf375c-57c9-4ae8-bb18-ee800cfa4993 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:13.426875 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948bdf7f-f3f5-47f6-aa56-98adf2dac6c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:13.428342 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948bdf7f-f3f5-47f6-aa56-98adf2dac6c1 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:13.482986 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 254/513] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Oct 1 20:33:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 01 20:33:13.483824 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bf375c-57c9-4ae8-bb18-ee800cfa4993 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:13.527418 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 260/514] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Oct 1 20:33:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 01 20:33:13.528256 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948bdf7f-f3f5-47f6-aa56-98adf2dac6c1 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:13.549222 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:13.568083 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:13.588212 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bf375c-57c9-4ae8-bb18-ee800cfa4993 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:13.622016 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99048af9-b5bb-4ead-ad88-bcbcb1fbd631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:13.622635 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99048af9-b5bb-4ead-ad88-bcbcb1fbd631 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:13.623093 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99048af9-b5bb-4ead-ad88-bcbcb1fbd631 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:13.623501 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99048af9-b5bb-4ead-ad88-bcbcb1fbd631 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:13.628180 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948bdf7f-f3f5-47f6-aa56-98adf2dac6c1 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:13.633225 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99048af9-b5bb-4ead-ad88-bcbcb1fbd631 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:13.634687 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99048af9-b5bb-4ead-ad88-bcbcb1fbd631 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:13.649401 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application [None req-99048af9-b5bb-4ead-ad88-bcbcb1fbd631 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:33:13.649401 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:13.649401 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:13.649401 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:13.649401 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:13.649401 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:13.649401 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:13.649401 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:13.649401 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:13.649401 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:13.649401 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:13.649401 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:13.649401 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 20:33:13.649401 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 20:33:13.649401 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 20:33:13.649401 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 20:33:13.650448 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:13.650448 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:13.650448 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:13.650448 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:13.650448 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:13.650448 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:13.650448 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:13.650448 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:13.650448 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:13.650448 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:13.650448 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:13.650448 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:13.650448 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:13.650448 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:13.650448 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:13.650448 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:13.650448 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 20:33:13.651323 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 20:33:13.651323 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:33:13.651323 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:33:13.651323 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 255/515] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Oct 1 20:33:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:13.651748 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99048af9-b5bb-4ead-ad88-bcbcb1fbd631 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:13.665439 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37b1649-285b-4f01-bf69-198e675c549a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:13.666034 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b1649-285b-4f01-bf69-198e675c549a None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:13.666306 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b1649-285b-4f01-bf69-198e675c549a None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:13.666572 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b1649-285b-4f01-bf69-198e675c549a None admin] PATH_INFO: `/v3/projects` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:13.667243 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37b1649-285b-4f01-bf69-198e675c549a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:13.667535 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37b1649-285b-4f01-bf69-198e675c549a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:13.668985 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37b1649-285b-4f01-bf69-198e675c549a None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:13.688329 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 261/516] 10.222.0.23 () {56 vars in 1148 bytes} [Sat Oct 1 20:33:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:13.689157 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37b1649-285b-4f01-bf69-198e675c549a None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:13.756774 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99048af9-b5bb-4ead-ad88-bcbcb1fbd631 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:13.774325 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:13.785972 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:13.791318 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0998a3a-4908-4b4e-872e-0eb6a5e42aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:13.791934 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0998a3a-4908-4b4e-872e-0eb6a5e42aa8 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:13.792205 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0998a3a-4908-4b4e-872e-0eb6a5e42aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:13.792470 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0998a3a-4908-4b4e-872e-0eb6a5e42aa8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:13.796720 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37b1649-285b-4f01-bf69-198e675c549a None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:13.803136 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0998a3a-4908-4b4e-872e-0eb6a5e42aa8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:13.804607 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0998a3a-4908-4b4e-872e-0eb6a5e42aa8 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:13.818796 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application [None req-f0998a3a-4908-4b4e-872e-0eb6a5e42aa8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:33:13.818796 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:13.818796 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:13.818796 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:13.818796 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:13.818796 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:13.818796 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:13.818796 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:13.818796 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:13.818796 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:13.818796 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:13.818796 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:13.818796 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 20:33:13.818796 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 20:33:13.818796 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 20:33:13.818796 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 20:33:13.819866 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:13.819866 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:13.819866 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:13.819866 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:13.819866 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:13.819866 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:13.819866 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:13.819866 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:13.819866 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:13.819866 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:13.819866 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:13.819866 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:13.819866 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:13.819866 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:13.819866 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:13.819866 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:13.819866 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 20:33:13.821011 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 20:33:13.821011 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:33:13.821011 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:33:13.821011 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 256/517] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Oct 1 20:33:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:13.821011 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0998a3a-4908-4b4e-872e-0eb6a5e42aa8 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:13.833257 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6741d5-606b-4dae-9879-d9a2a63ace19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:13.833886 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6741d5-606b-4dae-9879-d9a2a63ace19 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:13.834165 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6741d5-606b-4dae-9879-d9a2a63ace19 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:13.834441 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6741d5-606b-4dae-9879-d9a2a63ace19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:13.844567 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6741d5-606b-4dae-9879-d9a2a63ace19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:13.846018 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6741d5-606b-4dae-9879-d9a2a63ace19 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:13.860646 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-8e6741d5-606b-4dae-9879-d9a2a63ace19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:33:13.860646 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:13.860646 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:13.860646 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:13.860646 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:13.860646 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:13.860646 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:13.860646 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:13.860646 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:13.860646 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:13.860646 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:13.860646 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:13.860646 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 20:33:13.860646 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 20:33:13.860646 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 20:33:13.860646 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 20:33:13.861730 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:13.861730 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:13.861730 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:13.861730 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:13.861730 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:13.861730 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:13.861730 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:13.861730 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:13.861730 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:13.861730 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:13.861730 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:13.861730 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:13.861730 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:13.861730 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:13.861730 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:13.861730 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:13.861730 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 20:33:13.862771 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 20:33:13.862771 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:33:13.862771 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:33:13.862771 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 262/518] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Oct 1 20:33:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:13.863031 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6741d5-606b-4dae-9879-d9a2a63ace19 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:13.923199 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0998a3a-4908-4b4e-872e-0eb6a5e42aa8 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:13.956969 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2485ae85-5132-431b-bf9f-590ca55ac509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:13.957568 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2485ae85-5132-431b-bf9f-590ca55ac509 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:13.957846 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2485ae85-5132-431b-bf9f-590ca55ac509 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:13.958121 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2485ae85-5132-431b-bf9f-590ca55ac509 None admin] PATH_INFO: `/v3/domains` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:13.958751 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2485ae85-5132-431b-bf9f-590ca55ac509 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:13.959054 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2485ae85-5132-431b-bf9f-590ca55ac509 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:13.960418 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2485ae85-5132-431b-bf9f-590ca55ac509 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:13.960548 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6741d5-606b-4dae-9879-d9a2a63ace19 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:13.971876 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 257/519] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Oct 1 20:33:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:13.972753 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2485ae85-5132-431b-bf9f-590ca55ac509 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:13.991685 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:13.998477 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e5d5a5-7d73-4d1f-be6e-e30a538b16f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:13.999148 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e5d5a5-7d73-4d1f-be6e-e30a538b16f5 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:13.999485 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e5d5a5-7d73-4d1f-be6e-e30a538b16f5 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:13.999755 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e5d5a5-7d73-4d1f-be6e-e30a538b16f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:14.000464 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e5d5a5-7d73-4d1f-be6e-e30a538b16f5 None admin] RBAC: Adding query filter params (role.id=da1d78af3e8a425e8ce1130b079f8fce, scope.project.id=8f242c4eeaa04ed19dcdc8ba95b86cfb, user.id=b9c31d26f19d46f09e2f2e5e660234f2) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:14.000793 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e5d5a5-7d73-4d1f-be6e-e30a538b16f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:14.002222 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e5d5a5-7d73-4d1f-be6e-e30a538b16f5 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:14.007434 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 263/520] 10.222.0.23 () {56 vars in 1374 bytes} [Sat Oct 1 20:33:13 2022] GET /identity/v3/role_assignments?user.id=b9c31d26f19d46f09e2f2e5e660234f2&scope.project.id=8f242c4eeaa04ed19dcdc8ba95b86cfb&role.id=da1d78af3e8a425e8ce1130b079f8fce => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:14.008200 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e5d5a5-7d73-4d1f-be6e-e30a538b16f5 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:14.019119 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:14.083610 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2485ae85-5132-431b-bf9f-590ca55ac509 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:14.123388 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08acd396-dc57-463b-abf1-4fb61e54ce01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:14.124061 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08acd396-dc57-463b-abf1-4fb61e54ce01 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:14.124334 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08acd396-dc57-463b-abf1-4fb61e54ce01 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:14.124627 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08acd396-dc57-463b-abf1-4fb61e54ce01 None admin] PATH_INFO: `/v3/domains` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:14.125389 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08acd396-dc57-463b-abf1-4fb61e54ce01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:14.125706 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08acd396-dc57-463b-abf1-4fb61e54ce01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:14.127196 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08acd396-dc57-463b-abf1-4fb61e54ce01 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:14.134989 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e5d5a5-7d73-4d1f-be6e-e30a538b16f5 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:14.144881 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 258/521] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Oct 1 20:33:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:14.146133 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08acd396-dc57-463b-abf1-4fb61e54ce01 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:14.183599 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c8cece-b66e-4a2f-b8de-738c7a353c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:14.184222 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c8cece-b66e-4a2f-b8de-738c7a353c7c None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:14.184502 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c8cece-b66e-4a2f-b8de-738c7a353c7c None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:14.184833 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c8cece-b66e-4a2f-b8de-738c7a353c7c None admin] PATH_INFO: `/v3/domains` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:14.186204 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c8cece-b66e-4a2f-b8de-738c7a353c7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:14.186600 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c8cece-b66e-4a2f-b8de-738c7a353c7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:14.188097 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c8cece-b66e-4a2f-b8de-738c7a353c7c None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:14.206926 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 264/522] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Oct 1 20:33:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:14.206926 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c8cece-b66e-4a2f-b8de-738c7a353c7c None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:14.260410 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08acd396-dc57-463b-abf1-4fb61e54ce01 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:14.264842 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:14.268884 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:14.303501 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f1c40f-af1e-4a06-a254-6268ee439a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:14.304135 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f1c40f-af1e-4a06-a254-6268ee439a08 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:14.304411 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f1c40f-af1e-4a06-a254-6268ee439a08 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:14.305167 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f1c40f-af1e-4a06-a254-6268ee439a08 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:14.312383 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f1c40f-af1e-4a06-a254-6268ee439a08 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:14.313952 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f1c40f-af1e-4a06-a254-6268ee439a08 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:14.318928 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c8cece-b66e-4a2f-b8de-738c7a353c7c None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:14.327281 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application [None req-a7f1c40f-af1e-4a06-a254-6268ee439a08 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 20:33:14.327281 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:14.327281 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:14.327281 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:14.327281 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:14.327281 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:14.327281 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:14.327281 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:14.327281 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:14.327281 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:14.327281 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:14.327281 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:14.327281 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 01 20:33:14.327281 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 01 20:33:14.327281 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 01 20:33:14.328130 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 01 20:33:14.328130 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:14.328130 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:14.328130 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:14.328130 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:14.328130 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:14.328130 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:14.328130 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:14.328130 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:14.328130 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:14.328130 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:14.328130 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:14.328130 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:14.328130 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:14.328130 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:14.328130 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:14.328130 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:14.329846 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 01 20:33:14.329846 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 01 20:33:14.329846 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 01 20:33:14.329846 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 01 20:33:14.329846 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 01 20:33:14.329846 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 01 20:33:14.329846 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 20:33:14.329846 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:33:14.329846 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 259/523] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Oct 1 20:33:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:14.329846 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f1c40f-af1e-4a06-a254-6268ee439a08 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:14.359249 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac44c16-5d02-44f4-b30c-5d4af167ebb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:14.360338 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac44c16-5d02-44f4-b30c-5d4af167ebb2 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:14.360836 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac44c16-5d02-44f4-b30c-5d4af167ebb2 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:14.361345 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac44c16-5d02-44f4-b30c-5d4af167ebb2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:14.368510 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac44c16-5d02-44f4-b30c-5d4af167ebb2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:14.370352 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac44c16-5d02-44f4-b30c-5d4af167ebb2 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:14.383274 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-0ac44c16-5d02-44f4-b30c-5d4af167ebb2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 20:33:14.383274 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:14.383274 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:14.383274 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:14.383274 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:14.383274 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:14.383274 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:14.383274 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:14.383274 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:14.383274 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:14.383274 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:14.383274 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:14.383274 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 01 20:33:14.383274 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 01 20:33:14.383274 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 01 20:33:14.384298 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 01 20:33:14.384298 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:14.384298 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:14.384298 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:14.384298 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:14.384298 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:14.384298 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:14.384298 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:14.384298 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:14.384298 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:14.384298 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:14.384298 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:14.384298 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:14.384298 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:14.384298 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:14.384298 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:14.384298 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:14.385439 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 01 20:33:14.385439 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 01 20:33:14.385439 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 01 20:33:14.385439 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 01 20:33:14.385439 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 01 20:33:14.385439 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 01 20:33:14.385439 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 20:33:14.385439 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:33:14.385439 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 265/524] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Oct 1 20:33:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:14.386177 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac44c16-5d02-44f4-b30c-5d4af167ebb2 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:14.434375 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f1c40f-af1e-4a06-a254-6268ee439a08 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:14.472991 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c99c52-ece6-460c-aa58-07b78e9511a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:14.473707 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c99c52-ece6-460c-aa58-07b78e9511a6 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:14.474042 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c99c52-ece6-460c-aa58-07b78e9511a6 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:14.474454 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c99c52-ece6-460c-aa58-07b78e9511a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:14.482689 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c99c52-ece6-460c-aa58-07b78e9511a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:14.484556 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c99c52-ece6-460c-aa58-07b78e9511a6 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:14.491907 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac44c16-5d02-44f4-b30c-5d4af167ebb2 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:14.496426 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application [None req-89c99c52-ece6-460c-aa58-07b78e9511a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 20:33:14.496426 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:14.496426 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:14.496426 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:14.496426 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:14.496426 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:14.496426 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:14.496426 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:14.496426 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:14.496426 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:14.496426 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:14.496426 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:14.496426 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 01 20:33:14.496426 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 01 20:33:14.496426 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 01 20:33:14.497472 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 01 20:33:14.497472 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:14.497472 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:14.497472 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:14.497472 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:14.497472 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:14.497472 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:14.497472 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:14.497472 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:14.497472 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:14.497472 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:14.497472 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:14.497472 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:14.497472 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:14.497472 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:14.497472 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:14.497472 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:14.498652 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 01 20:33:14.498652 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 01 20:33:14.498652 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 01 20:33:14.498652 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 01 20:33:14.498652 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 01 20:33:14.498652 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 01 20:33:14.498652 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 20:33:14.498652 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:33:14.499414 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 260/525] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Oct 1 20:33:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:14.500406 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c99c52-ece6-460c-aa58-07b78e9511a6 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:14.508682 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:14.530963 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:14.535405 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad687dd-97e8-4d1c-845b-3652a5168b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:14.536014 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad687dd-97e8-4d1c-845b-3652a5168b76 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:14.536297 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad687dd-97e8-4d1c-845b-3652a5168b76 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:14.536594 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad687dd-97e8-4d1c-845b-3652a5168b76 None admin] PATH_INFO: `/v3/projects` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:14.537288 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad687dd-97e8-4d1c-845b-3652a5168b76 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:14.537603 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad687dd-97e8-4d1c-845b-3652a5168b76 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:14.539020 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad687dd-97e8-4d1c-845b-3652a5168b76 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:14.551241 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 266/526] 10.222.0.23 () {56 vars in 1148 bytes} [Sat Oct 1 20:33:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:14.552060 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad687dd-97e8-4d1c-845b-3652a5168b76 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:14.625940 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c99c52-ece6-460c-aa58-07b78e9511a6 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:14.661046 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad687dd-97e8-4d1c-845b-3652a5168b76 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:14.665637 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed4bb22-58e3-4ac4-83cb-e9023ba34b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:14.666523 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4bb22-58e3-4ac4-83cb-e9023ba34b5f None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:14.666801 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4bb22-58e3-4ac4-83cb-e9023ba34b5f None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:14.667072 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4bb22-58e3-4ac4-83cb-e9023ba34b5f None admin] PATH_INFO: `/v3/projects` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:14.667750 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed4bb22-58e3-4ac4-83cb-e9023ba34b5f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:14.668050 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed4bb22-58e3-4ac4-83cb-e9023ba34b5f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:14.670211 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed4bb22-58e3-4ac4-83cb-e9023ba34b5f None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:14.694649 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 261/527] 10.222.0.23 () {56 vars in 1148 bytes} [Sat Oct 1 20:33:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:14.694649 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed4bb22-58e3-4ac4-83cb-e9023ba34b5f None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:14.700255 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cacb5db-b6cc-4862-b7ff-85934c8427ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:14.700926 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cacb5db-b6cc-4862-b7ff-85934c8427ca None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:14.701200 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cacb5db-b6cc-4862-b7ff-85934c8427ca None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:14.701471 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cacb5db-b6cc-4862-b7ff-85934c8427ca None admin] PATH_INFO: `/v3/projects` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:14.702273 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cacb5db-b6cc-4862-b7ff-85934c8427ca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:14.702573 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cacb5db-b6cc-4862-b7ff-85934c8427ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:14.703995 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cacb5db-b6cc-4862-b7ff-85934c8427ca None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:14.716197 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 267/528] 10.222.0.23 () {56 vars in 1148 bytes} [Sat Oct 1 20:33:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:14.717583 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cacb5db-b6cc-4862-b7ff-85934c8427ca None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:14.756107 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:14.796062 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:14.814892 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed4bb22-58e3-4ac4-83cb-e9023ba34b5f None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:14.825977 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cacb5db-b6cc-4862-b7ff-85934c8427ca None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:14.849940 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05c4d77-95ab-44d3-93a8-245ee31d4934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:14.850532 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c4d77-95ab-44d3-93a8-245ee31d4934 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:14.850805 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c4d77-95ab-44d3-93a8-245ee31d4934 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:14.851071 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c4d77-95ab-44d3-93a8-245ee31d4934 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:14.851782 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05c4d77-95ab-44d3-93a8-245ee31d4934 None admin] RBAC: Adding query filter params (role.id=da1d78af3e8a425e8ce1130b079f8fce, scope.project.id=8f242c4eeaa04ed19dcdc8ba95b86cfb, user.id=1b737fe6e9f34adf8eef1851a4a89ca6) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:14.852084 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05c4d77-95ab-44d3-93a8-245ee31d4934 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:14.853551 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05c4d77-95ab-44d3-93a8-245ee31d4934 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:14.858753 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 262/529] 10.222.0.23 () {56 vars in 1374 bytes} [Sat Oct 1 20:33:14 2022] GET /identity/v3/role_assignments?user.id=1b737fe6e9f34adf8eef1851a4a89ca6&scope.project.id=8f242c4eeaa04ed19dcdc8ba95b86cfb&role.id=da1d78af3e8a425e8ce1130b079f8fce => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:14.859520 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05c4d77-95ab-44d3-93a8-245ee31d4934 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:14.873909 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ee8b78-273e-441f-a895-cb340376a6c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:14.874987 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ee8b78-273e-441f-a895-cb340376a6c1 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:14.875448 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ee8b78-273e-441f-a895-cb340376a6c1 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:14.875890 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ee8b78-273e-441f-a895-cb340376a6c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:14.877028 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ee8b78-273e-441f-a895-cb340376a6c1 None admin] RBAC: Adding query filter params (role.id=da1d78af3e8a425e8ce1130b079f8fce, scope.project.id=8f242c4eeaa04ed19dcdc8ba95b86cfb, user.id=4029dd2379eb4f5aab7c129a94d29b0c) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:14.877536 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ee8b78-273e-441f-a895-cb340376a6c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:14.879345 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ee8b78-273e-441f-a895-cb340376a6c1 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:14.892577 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 268/530] 10.222.0.23 () {56 vars in 1374 bytes} [Sat Oct 1 20:33:14 2022] GET /identity/v3/role_assignments?user.id=4029dd2379eb4f5aab7c129a94d29b0c&scope.project.id=8f242c4eeaa04ed19dcdc8ba95b86cfb&role.id=da1d78af3e8a425e8ce1130b079f8fce => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:14.992539 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05c4d77-95ab-44d3-93a8-245ee31d4934 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:15.037069 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834ed638-c63e-45f4-aaca-50b9c84c3aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:15.037691 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ed638-c63e-45f4-aaca-50b9c84c3aa0 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:15.037969 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ed638-c63e-45f4-aaca-50b9c84c3aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:15.038241 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ed638-c63e-45f4-aaca-50b9c84c3aa0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:15.038975 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834ed638-c63e-45f4-aaca-50b9c84c3aa0 None admin] RBAC: Adding query filter params (role.id=da1d78af3e8a425e8ce1130b079f8fce, scope.project.id=8f242c4eeaa04ed19dcdc8ba95b86cfb, user.id=d498314742474614b90a1350359f506a) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:15.039283 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834ed638-c63e-45f4-aaca-50b9c84c3aa0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:15.040816 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834ed638-c63e-45f4-aaca-50b9c84c3aa0 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:15.048761 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 263/531] 10.222.0.23 () {56 vars in 1374 bytes} [Sat Oct 1 20:33:14 2022] GET /identity/v3/role_assignments?user.id=d498314742474614b90a1350359f506a&scope.project.id=8f242c4eeaa04ed19dcdc8ba95b86cfb&role.id=da1d78af3e8a425e8ce1130b079f8fce => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:16.470383 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd874e2c-a9d4-4344-96e7-8f3bef9c4dea None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:16.470938 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd874e2c-a9d4-4344-96e7-8f3bef9c4dea None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:16.470938 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd874e2c-a9d4-4344-96e7-8f3bef9c4dea None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:16.472535 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 269/532] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:33:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:33:16.477795 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f005a093-aeda-4a31-acde-fe430b5d9a79 None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:16.478197 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f005a093-aeda-4a31-acde-fe430b5d9a79 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:16.478374 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f005a093-aeda-4a31-acde-fe430b5d9a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:16.497087 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-f005a093-aeda-4a31-acde-fe430b5d9a79 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:33:16.498343 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-f005a093-aeda-4a31-acde-fe430b5d9a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:33:16.506202 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:16.573318 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 264/533] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:33:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 01 20:33:16.895881 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd874e2c-a9d4-4344-96e7-8f3bef9c4dea None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:17.011987 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:17.017436 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd874e2c-a9d4-4344-96e7-8f3bef9c4dea None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:17.056162 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc489d7-b6c4-4ee0-86a2-c8a2321609eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:17.056834 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc489d7-b6c4-4ee0-86a2-c8a2321609eb None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:17.057111 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc489d7-b6c4-4ee0-86a2-c8a2321609eb None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:17.057384 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc489d7-b6c4-4ee0-86a2-c8a2321609eb None admin] PATH_INFO: `/v3/roles/service` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:17.069136 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc489d7-b6c4-4ee0-86a2-c8a2321609eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 20:33:17.073902 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-3cc489d7-b6c4-4ee0-86a2-c8a2321609eb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 01 20:33:17.073902 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:17.073902 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:17.073902 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:17.073902 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:17.073902 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:17.073902 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:17.073902 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:17.073902 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:17.073902 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:17.073902 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:17.073902 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:17.073902 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 20:33:17.073902 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 20:33:17.073902 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 20:33:17.073902 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 20:33:17.074831 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 20:33:17.074831 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 20:33:17.074831 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 20:33:17.074831 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 20:33:17.074831 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:17.074831 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:17.074831 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:17.074831 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:17.074831 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:17.074831 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:17.074831 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:17.074831 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:17.074831 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:17.074831 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:17.074831 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:17.074831 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:17.076350 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:17.076350 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:17.076350 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:17.076350 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:17.076350 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 20:33:17.076350 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 20:33:17.076350 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 20:33:17.076350 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 20:33:17.076350 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 20:33:17.076350 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 20:33:17.076350 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 01 20:33:17.076350 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:33:17.076350 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 270/534] 10.222.0.23 () {56 vars in 1102 bytes} [Sat Oct 1 20:33:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:17.080772 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f005a093-aeda-4a31-acde-fe430b5d9a79 None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:17.195213 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f005a093-aeda-4a31-acde-fe430b5d9a79 None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:17.234694 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6245db7-1472-4336-ba30-600d6d49e82c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:17.235301 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6245db7-1472-4336-ba30-600d6d49e82c None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:17.235580 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6245db7-1472-4336-ba30-600d6d49e82c None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:17.235849 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6245db7-1472-4336-ba30-600d6d49e82c None admin] PATH_INFO: `/v3/roles` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:17.236508 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6245db7-1472-4336-ba30-600d6d49e82c None admin] RBAC: Adding query filter params (name=service) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:17.236833 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6245db7-1472-4336-ba30-600d6d49e82c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:17.238259 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6245db7-1472-4336-ba30-600d6d49e82c None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:17.246997 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 265/535] 10.222.0.23 () {56 vars in 1103 bytes} [Sat Oct 1 20:33:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 20:33:17.253593 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc489d7-b6c4-4ee0-86a2-c8a2321609eb None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:17.364505 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc489d7-b6c4-4ee0-86a2-c8a2321609eb None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:17.395424 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83866a74-d733-42e3-aca2-777857e15cb3 None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:17.395729 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83866a74-d733-42e3-aca2-777857e15cb3 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:17.395964 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83866a74-d733-42e3-aca2-777857e15cb3 None None] PATH_INFO: `/` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:17.397469 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 266/536] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:33:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 01 20:33:17.405496 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd2f772-39ea-40e9-9d53-b340f25da9fa None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:17.405782 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd2f772-39ea-40e9-9d53-b340f25da9fa None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:17.406060 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd2f772-39ea-40e9-9d53-b340f25da9fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:17.407603 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cceafc6-6726-4e2b-b93f-6db10426b100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:17.408489 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cceafc6-6726-4e2b-b93f-6db10426b100 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:17.409091 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cceafc6-6726-4e2b-b93f-6db10426b100 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:17.409552 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cceafc6-6726-4e2b-b93f-6db10426b100 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:17.413543 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:17.421208 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cceafc6-6726-4e2b-b93f-6db10426b100 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:17.422969 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cceafc6-6726-4e2b-b93f-6db10426b100 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:17.425991 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-5cd2f772-39ea-40e9-9d53-b340f25da9fa None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:33:17.427132 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-5cd2f772-39ea-40e9-9d53-b340f25da9fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:33:17.439080 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-0cceafc6-6726-4e2b-b93f-6db10426b100 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:33:17.439080 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:17.439080 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:17.439080 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:17.439080 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:17.439080 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:17.439080 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:17.439080 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:17.439080 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:17.439080 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:17.439080 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:17.439080 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:17.439080 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 20:33:17.439080 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 20:33:17.439080 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 20:33:17.439080 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 20:33:17.440016 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:17.440016 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:17.440016 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:17.440016 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:17.440016 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:17.440016 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:17.440016 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:17.440016 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:17.440016 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:17.440016 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:17.440016 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:17.440016 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:17.440016 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:17.440016 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:17.440016 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:17.440016 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:17.440016 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 20:33:17.440892 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 20:33:17.440892 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:33:17.440892 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:33:17.443211 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 271/537] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Oct 1 20:33:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:17.448134 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cceafc6-6726-4e2b-b93f-6db10426b100 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:17.463870 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:17.504906 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 267/538] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:33:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 01 20:33:17.504906 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f26d69-8e3c-4dde-bcd9-3717c8f43bb5 None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:17.505552 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f26d69-8e3c-4dde-bcd9-3717c8f43bb5 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:17.505552 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f26d69-8e3c-4dde-bcd9-3717c8f43bb5 None None] PATH_INFO: `/` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:17.510441 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 268/539] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:33:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:33:17.515316 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8a6096-0293-4d04-9a65-a162aa9cafcb None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:17.515594 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8a6096-0293-4d04-9a65-a162aa9cafcb None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:17.515866 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8a6096-0293-4d04-9a65-a162aa9cafcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:17.534888 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-5d8a6096-0293-4d04-9a65-a162aa9cafcb None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:33:17.536073 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-5d8a6096-0293-4d04-9a65-a162aa9cafcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:33:17.569301 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cceafc6-6726-4e2b-b93f-6db10426b100 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:17.605274 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601e1846-cbfe-4da2-ba0a-a6365d0e2ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:17.605874 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601e1846-cbfe-4da2-ba0a-a6365d0e2ca2 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:17.606149 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601e1846-cbfe-4da2-ba0a-a6365d0e2ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:17.606420 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601e1846-cbfe-4da2-ba0a-a6365d0e2ca2 None admin] PATH_INFO: `/v3/domains` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:17.607077 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601e1846-cbfe-4da2-ba0a-a6365d0e2ca2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:17.607936 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601e1846-cbfe-4da2-ba0a-a6365d0e2ca2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:17.609340 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601e1846-cbfe-4da2-ba0a-a6365d0e2ca2 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:17.610418 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 269/540] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:33:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 20:33:17.613790 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f5744b-dcca-4f1f-82d8-d7bbb6c0d9e7 None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:17.614070 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f5744b-dcca-4f1f-82d8-d7bbb6c0d9e7 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:17.614340 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f5744b-dcca-4f1f-82d8-d7bbb6c0d9e7 None None] PATH_INFO: `/` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:17.619498 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 270/541] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:33:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:33:17.620677 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e3094a-3808-4af0-b372-1fe45f7ce828 None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:17.621055 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e3094a-3808-4af0-b372-1fe45f7ce828 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:17.621425 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e3094a-3808-4af0-b372-1fe45f7ce828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:17.633008 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 272/542] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Oct 1 20:33:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 20:33:17.641512 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601e1846-cbfe-4da2-ba0a-a6365d0e2ca2 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:17.645048 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-56e3094a-3808-4af0-b372-1fe45f7ce828 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:33:17.646585 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-56e3094a-3808-4af0-b372-1fe45f7ce828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:33:17.719283 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:17.729473 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 271/543] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:33:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 20:33:17.729959 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:17.767382 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601e1846-cbfe-4da2-ba0a-a6365d0e2ca2 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:17.803187 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354eb56d-394d-41d2-af39-33657e5678d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:17.804480 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354eb56d-394d-41d2-af39-33657e5678d9 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:17.805005 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354eb56d-394d-41d2-af39-33657e5678d9 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:17.805472 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354eb56d-394d-41d2-af39-33657e5678d9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:17.814041 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354eb56d-394d-41d2-af39-33657e5678d9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:17.815704 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354eb56d-394d-41d2-af39-33657e5678d9 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:17.827917 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-354eb56d-394d-41d2-af39-33657e5678d9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 01 20:33:17.827917 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:17.827917 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:17.827917 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:17.827917 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:17.827917 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:17.827917 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:17.827917 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:17.827917 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:17.827917 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:17.827917 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:17.827917 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:17.827917 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 01 20:33:17.827917 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 01 20:33:17.827917 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 01 20:33:17.827917 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 01 20:33:17.828923 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:17.828923 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:17.828923 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 01 20:33:17.828923 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 20:33:17.828923 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 01 20:33:17.828923 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 20:33:17.828923 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:17.828923 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:17.828923 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:17.828923 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:17.828923 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:17.828923 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:17.828923 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:17.828923 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:17.828923 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:17.828923 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:17.828923 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:17.828923 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:17.829824 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:17.829824 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:17.829824 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 01 20:33:17.829824 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 01 20:33:17.829824 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 01 20:33:17.829824 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 01 20:33:17.829824 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 01 20:33:17.829824 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 01 20:33:17.829824 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 01 20:33:17.829824 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:33:17.832193 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 273/544] 10.222.0.23 () {56 vars in 1093 bytes} [Sat Oct 1 20:33:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:17.838380 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e3094a-3808-4af0-b372-1fe45f7ce828 None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:17.839669 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354eb56d-394d-41d2-af39-33657e5678d9 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:17.964362 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e3094a-3808-4af0-b372-1fe45f7ce828 None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:17.964840 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354eb56d-394d-41d2-af39-33657e5678d9 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:17.999540 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:18.002874 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca66953-8c64-460d-853b-a8c8a07c5a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:18.003476 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca66953-8c64-460d-853b-a8c8a07c5a02 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:18.003758 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca66953-8c64-460d-853b-a8c8a07c5a02 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:18.004031 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca66953-8c64-460d-853b-a8c8a07c5a02 None admin] PATH_INFO: `/v3/users` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:18.004776 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca66953-8c64-460d-853b-a8c8a07c5a02 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:18.005079 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca66953-8c64-460d-853b-a8c8a07c5a02 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:18.006432 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67252fa-7569-4485-9f0a-f47028986a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:18.006566 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca66953-8c64-460d-853b-a8c8a07c5a02 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:18.007333 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67252fa-7569-4485-9f0a-f47028986a6a None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:18.007754 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67252fa-7569-4485-9f0a-f47028986a6a None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:18.008174 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67252fa-7569-4485-9f0a-f47028986a6a None admin] PATH_INFO: `/v3/roles/service` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:18.019778 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67252fa-7569-4485-9f0a-f47028986a6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 20:33:18.024953 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 272/545] 10.222.0.23 () {56 vars in 1133 bytes} [Sat Oct 1 20:33:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:18.025388 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-a67252fa-7569-4485-9f0a-f47028986a6a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 01 20:33:18.025388 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:18.025388 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:18.025388 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:18.025388 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:18.025388 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:18.025388 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:18.025388 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:18.025388 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:18.025388 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:18.025388 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:18.025388 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:18.025388 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 20:33:18.025388 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 20:33:18.025388 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 20:33:18.025388 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 20:33:18.026397 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 20:33:18.026397 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 20:33:18.026397 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 20:33:18.026397 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 20:33:18.026397 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:18.026397 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:18.026397 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:18.026397 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:18.026397 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:18.026397 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:18.026397 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:18.026397 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:18.026397 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:18.026397 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:18.026397 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:18.026397 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:18.027175 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:18.027175 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:18.027175 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:18.027175 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:18.027175 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 20:33:18.027175 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 20:33:18.027175 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 20:33:18.027175 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 20:33:18.027175 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 20:33:18.027175 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 20:33:18.027175 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 01 20:33:18.027175 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:33:18.027786 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca66953-8c64-460d-853b-a8c8a07c5a02 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:18.034034 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 274/546] 10.222.0.23 () {56 vars in 1102 bytes} [Sat Oct 1 20:33:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:18.035054 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67252fa-7569-4485-9f0a-f47028986a6a None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:18.084750 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:18.131356 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca66953-8c64-460d-853b-a8c8a07c5a02 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:18.151796 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67252fa-7569-4485-9f0a-f47028986a6a None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:18.167988 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b8ae99-4c09-4a90-9e15-8d65d7dbd6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:18.168657 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b8ae99-4c09-4a90-9e15-8d65d7dbd6fe None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:18.168937 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b8ae99-4c09-4a90-9e15-8d65d7dbd6fe None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:18.169211 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b8ae99-4c09-4a90-9e15-8d65d7dbd6fe None admin] PATH_INFO: `/v3/roles/service` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:18.182553 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b8ae99-4c09-4a90-9e15-8d65d7dbd6fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 20:33:18.186763 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f390d25-fe6e-4e01-a8d9-38225b21a86e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:18.187301 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application [None req-c1b8ae99-4c09-4a90-9e15-8d65d7dbd6fe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 01 20:33:18.187301 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:18.187301 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:18.187301 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:18.187301 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:18.187301 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:18.187301 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:18.187301 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:18.187301 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:18.187301 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:18.187301 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:18.187301 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:18.187301 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 20:33:18.187301 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 20:33:18.187301 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 20:33:18.187301 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 20:33:18.188365 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 20:33:18.188365 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 20:33:18.188365 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 20:33:18.188365 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 20:33:18.188365 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:18.188365 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:18.188365 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:18.188365 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:18.188365 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:18.188365 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:18.188365 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:18.188365 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:18.188365 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:18.188365 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:18.188365 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:18.188365 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:18.189226 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:18.189226 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:18.189226 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:18.189226 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:18.189226 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 20:33:18.189226 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 20:33:18.189226 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 20:33:18.189226 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 20:33:18.189226 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 20:33:18.189226 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 20:33:18.189226 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 01 20:33:18.189226 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:33:18.189832 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f390d25-fe6e-4e01-a8d9-38225b21a86e None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:18.189832 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f390d25-fe6e-4e01-a8d9-38225b21a86e None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:18.189832 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f390d25-fe6e-4e01-a8d9-38225b21a86e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:18.190023 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 273/547] 10.222.0.23 () {56 vars in 1102 bytes} [Sat Oct 1 20:33:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:18.190023 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b8ae99-4c09-4a90-9e15-8d65d7dbd6fe None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:18.201126 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f390d25-fe6e-4e01-a8d9-38225b21a86e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:18.203013 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f390d25-fe6e-4e01-a8d9-38225b21a86e None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:18.218191 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-4f390d25-fe6e-4e01-a8d9-38225b21a86e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:33:18.218191 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:18.218191 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:18.218191 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:18.218191 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:18.218191 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:18.218191 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:18.218191 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:18.218191 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:18.218191 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:18.218191 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:18.218191 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:18.218191 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 20:33:18.218191 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 20:33:18.218191 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 20:33:18.218191 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 20:33:18.219261 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:18.219261 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:18.219261 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:18.219261 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:18.219261 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:18.219261 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:18.219261 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:18.219261 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:18.219261 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:18.219261 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:18.219261 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:18.219261 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:18.219261 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:18.219261 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:18.219261 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:18.219261 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:18.219261 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 20:33:18.220519 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 20:33:18.220519 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:33:18.220519 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:33:18.220519 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 275/548] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Oct 1 20:33:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:18.220519 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f390d25-fe6e-4e01-a8d9-38225b21a86e None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:18.262706 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:18.293586 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b8ae99-4c09-4a90-9e15-8d65d7dbd6fe None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:18.306973 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:18.321716 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f390d25-fe6e-4e01-a8d9-38225b21a86e None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:18.329275 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f55fcb-2331-4a35-99f8-1fa7eb879609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:18.329875 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f55fcb-2331-4a35-99f8-1fa7eb879609 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:18.330154 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f55fcb-2331-4a35-99f8-1fa7eb879609 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:18.330697 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f55fcb-2331-4a35-99f8-1fa7eb879609 None admin] PATH_INFO: `/v3/roles` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:18.331079 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f55fcb-2331-4a35-99f8-1fa7eb879609 None admin] RBAC: Adding query filter params (name=service) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:18.331379 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f55fcb-2331-4a35-99f8-1fa7eb879609 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:18.332801 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f55fcb-2331-4a35-99f8-1fa7eb879609 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:18.340482 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 274/549] 10.222.0.23 () {56 vars in 1103 bytes} [Sat Oct 1 20:33:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:18.341843 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f55fcb-2331-4a35-99f8-1fa7eb879609 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:18.360972 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aff3bfc-3f34-436c-8552-845788ca26d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:18.361595 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff3bfc-3f34-436c-8552-845788ca26d4 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:18.361878 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff3bfc-3f34-436c-8552-845788ca26d4 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:18.362155 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff3bfc-3f34-436c-8552-845788ca26d4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:18.371999 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aff3bfc-3f34-436c-8552-845788ca26d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 20:33:18.377337 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-0aff3bfc-3f34-436c-8552-845788ca26d4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 01 20:33:18.377337 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:18.377337 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:18.377337 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:18.377337 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:18.377337 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:18.377337 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:18.377337 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:18.377337 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:18.377337 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:18.377337 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:18.377337 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:18.377337 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 20:33:18.377337 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 20:33:18.377337 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 20:33:18.377337 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 20:33:18.378384 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 20:33:18.378384 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 20:33:18.378384 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 20:33:18.378384 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 20:33:18.378384 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:18.378384 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:18.378384 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:18.378384 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:18.378384 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:18.378384 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:18.378384 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:18.378384 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:18.378384 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:18.378384 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:18.378384 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:18.378384 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:18.379164 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:18.379164 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:18.379164 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:18.379164 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:18.379164 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 20:33:18.379164 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 20:33:18.379164 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 20:33:18.379164 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 20:33:18.379164 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 20:33:18.379164 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 20:33:18.379164 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 01 20:33:18.379164 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:33:18.379164 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 276/550] 10.222.0.23 () {56 vars in 1102 bytes} [Sat Oct 1 20:33:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:18.379164 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aff3bfc-3f34-436c-8552-845788ca26d4 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:18.439066 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f55fcb-2331-4a35-99f8-1fa7eb879609 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:18.472356 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab7148c-7c27-4cca-80a2-426c48f6e51f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:18.472982 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab7148c-7c27-4cca-80a2-426c48f6e51f None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:18.473258 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab7148c-7c27-4cca-80a2-426c48f6e51f None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:18.473528 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab7148c-7c27-4cca-80a2-426c48f6e51f None admin] PATH_INFO: `/v3/roles` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:18.474180 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab7148c-7c27-4cca-80a2-426c48f6e51f None admin] RBAC: Adding query filter params (name=service) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:18.474485 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab7148c-7c27-4cca-80a2-426c48f6e51f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:18.475842 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab7148c-7c27-4cca-80a2-426c48f6e51f None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:18.477930 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aff3bfc-3f34-436c-8552-845788ca26d4 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:18.479513 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:18.483836 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 275/551] 10.222.0.23 () {56 vars in 1103 bytes} [Sat Oct 1 20:33:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:18.484657 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab7148c-7c27-4cca-80a2-426c48f6e51f None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:18.515756 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c85353d-fb07-4f3a-a3f0-2c0eddd65562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:18.516278 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c85353d-fb07-4f3a-a3f0-2c0eddd65562 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:18.516614 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c85353d-fb07-4f3a-a3f0-2c0eddd65562 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:18.516888 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c85353d-fb07-4f3a-a3f0-2c0eddd65562 None admin] PATH_INFO: `/v3/domains` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:18.517518 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c85353d-fb07-4f3a-a3f0-2c0eddd65562 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:18.517817 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c85353d-fb07-4f3a-a3f0-2c0eddd65562 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:18.519183 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c85353d-fb07-4f3a-a3f0-2c0eddd65562 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:18.519836 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:18.530946 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 277/552] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Oct 1 20:33:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:18.531746 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c85353d-fb07-4f3a-a3f0-2c0eddd65562 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:18.584779 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab7148c-7c27-4cca-80a2-426c48f6e51f None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:18.617184 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9936ff1c-edc5-4939-89ca-af926f4b8f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:18.617804 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9936ff1c-edc5-4939-89ca-af926f4b8f76 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:18.618079 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9936ff1c-edc5-4939-89ca-af926f4b8f76 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:18.618346 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9936ff1c-edc5-4939-89ca-af926f4b8f76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:18.629403 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9936ff1c-edc5-4939-89ca-af926f4b8f76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:18.630835 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9936ff1c-edc5-4939-89ca-af926f4b8f76 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:18.631876 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c85353d-fb07-4f3a-a3f0-2c0eddd65562 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:18.645478 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application [None req-9936ff1c-edc5-4939-89ca-af926f4b8f76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:33:18.645478 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:18.645478 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:18.645478 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:18.645478 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:18.645478 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:18.645478 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:18.645478 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:18.645478 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:18.645478 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:18.645478 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:18.645478 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:18.645478 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 20:33:18.645478 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 20:33:18.645478 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 20:33:18.645478 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 20:33:18.646475 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:18.646475 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:18.646475 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:18.646475 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:18.646475 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:18.646475 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:18.646475 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:18.646475 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:18.646475 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:18.646475 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:18.646475 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:18.646475 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:18.646475 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:18.646475 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:18.646475 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:18.646475 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:18.646475 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 20:33:18.652358 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 20:33:18.652358 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:33:18.652358 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:33:18.652358 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 276/553] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Oct 1 20:33:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:18.652358 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9936ff1c-edc5-4939-89ca-af926f4b8f76 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:18.666663 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f99349e-a552-43dc-931c-82dc7179cc3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:18.667265 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99349e-a552-43dc-931c-82dc7179cc3d None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:18.667550 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99349e-a552-43dc-931c-82dc7179cc3d None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:18.667820 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99349e-a552-43dc-931c-82dc7179cc3d None admin] PATH_INFO: `/v3/roles` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:18.668484 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f99349e-a552-43dc-931c-82dc7179cc3d None admin] RBAC: Adding query filter params (name=service) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:18.668812 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f99349e-a552-43dc-931c-82dc7179cc3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:18.670189 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f99349e-a552-43dc-931c-82dc7179cc3d None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:18.677987 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 278/554] 10.222.0.23 () {56 vars in 1103 bytes} [Sat Oct 1 20:33:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:18.678932 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f99349e-a552-43dc-931c-82dc7179cc3d None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:18.709786 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:18.739675 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:18.752215 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9936ff1c-edc5-4939-89ca-af926f4b8f76 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:18.785227 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0e6ed3-5988-44c7-b64c-c78a1f0b16f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:18.785758 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f99349e-a552-43dc-931c-82dc7179cc3d None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:18.785862 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0e6ed3-5988-44c7-b64c-c78a1f0b16f8 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:18.786050 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0e6ed3-5988-44c7-b64c-c78a1f0b16f8 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:18.786320 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0e6ed3-5988-44c7-b64c-c78a1f0b16f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:18.797929 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0e6ed3-5988-44c7-b64c-c78a1f0b16f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:18.799452 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0e6ed3-5988-44c7-b64c-c78a1f0b16f8 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:18.813182 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application [None req-da0e6ed3-5988-44c7-b64c-c78a1f0b16f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:33:18.813182 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:18.813182 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:18.813182 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:18.813182 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:18.813182 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:18.813182 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:18.813182 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:18.813182 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:18.813182 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:18.813182 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:18.813182 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:18.813182 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 20:33:18.813182 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 20:33:18.813182 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 20:33:18.813182 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 20:33:18.814097 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:18.814097 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:18.814097 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:18.814097 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:18.814097 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:18.814097 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:18.814097 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:18.814097 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:18.814097 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:18.814097 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:18.814097 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:18.814097 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:18.814097 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:18.814097 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:18.814097 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:18.814097 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:18.814097 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 20:33:18.814977 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 20:33:18.814977 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:33:18.814977 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:33:18.814977 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 277/555] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Oct 1 20:33:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:18.814977 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0e6ed3-5988-44c7-b64c-c78a1f0b16f8 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:18.824584 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53afff1-6bdf-421b-b06b-cb3a891bc23e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:18.825206 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53afff1-6bdf-421b-b06b-cb3a891bc23e None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:18.825479 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53afff1-6bdf-421b-b06b-cb3a891bc23e None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:18.826338 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53afff1-6bdf-421b-b06b-cb3a891bc23e None admin] PATH_INFO: `/v3/projects/service` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:18.833009 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53afff1-6bdf-421b-b06b-cb3a891bc23e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:18.834460 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53afff1-6bdf-421b-b06b-cb3a891bc23e None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:18.845743 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-a53afff1-6bdf-421b-b06b-cb3a891bc23e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 20:33:18.845743 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:18.845743 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:18.845743 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:18.845743 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:18.845743 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:18.845743 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:18.845743 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:18.845743 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:18.845743 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:18.845743 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:18.845743 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:18.845743 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 01 20:33:18.845743 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 01 20:33:18.845743 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 01 20:33:18.846637 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 01 20:33:18.846637 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:18.846637 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:18.846637 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:18.846637 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:18.846637 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:18.846637 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:18.846637 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:18.846637 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:18.846637 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:18.846637 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:18.846637 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:18.846637 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:18.846637 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:18.846637 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:18.846637 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:18.846637 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:18.847506 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 01 20:33:18.847506 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 01 20:33:18.847506 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 01 20:33:18.847506 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 01 20:33:18.847506 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 01 20:33:18.847506 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 01 20:33:18.847506 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 20:33:18.847506 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:33:18.847506 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 279/556] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Oct 1 20:33:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:18.847993 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53afff1-6bdf-421b-b06b-cb3a891bc23e None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:18.920458 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0e6ed3-5988-44c7-b64c-c78a1f0b16f8 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:18.930541 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:18.946346 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53afff1-6bdf-421b-b06b-cb3a891bc23e None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:18.954191 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb10971-f345-44a6-904e-b370dfdf222d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:18.954788 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb10971-f345-44a6-904e-b370dfdf222d None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:18.955063 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb10971-f345-44a6-904e-b370dfdf222d None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:18.955338 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb10971-f345-44a6-904e-b370dfdf222d None admin] PATH_INFO: `/v3/domains` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:18.955970 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb10971-f345-44a6-904e-b370dfdf222d None admin] RBAC: Adding query filter params (name=Default) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:18.956297 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb10971-f345-44a6-904e-b370dfdf222d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:18.957692 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb10971-f345-44a6-904e-b370dfdf222d None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:18.966132 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:18.969714 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 278/557] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Oct 1 20:33:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:18.970443 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb10971-f345-44a6-904e-b370dfdf222d None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:18.986060 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6019e60b-8f13-4dcc-9c10-ee1fe51842f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:18.986677 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6019e60b-8f13-4dcc-9c10-ee1fe51842f2 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:18.986952 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6019e60b-8f13-4dcc-9c10-ee1fe51842f2 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:18.987219 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6019e60b-8f13-4dcc-9c10-ee1fe51842f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:18.997544 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6019e60b-8f13-4dcc-9c10-ee1fe51842f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:18.999084 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6019e60b-8f13-4dcc-9c10-ee1fe51842f2 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:19.012828 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-6019e60b-8f13-4dcc-9c10-ee1fe51842f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:33:19.012828 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:19.012828 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:19.012828 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:19.012828 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:19.012828 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:19.012828 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:19.012828 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:19.012828 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:19.012828 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:19.012828 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:19.012828 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:19.012828 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 20:33:19.012828 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 20:33:19.012828 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 20:33:19.012828 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 20:33:19.015194 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:19.015194 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:19.015194 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:19.015194 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:19.015194 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:19.015194 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:19.015194 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:19.015194 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:19.015194 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:19.015194 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:19.015194 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:19.015194 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:19.015194 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:19.015194 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:19.015194 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:19.015194 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:19.015194 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 20:33:19.016080 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 20:33:19.016080 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:33:19.016080 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:33:19.016080 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 280/558] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Oct 1 20:33:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:19.016080 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6019e60b-8f13-4dcc-9c10-ee1fe51842f2 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:19.073352 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb10971-f345-44a6-904e-b370dfdf222d None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:19.106827 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4cd59b-6856-4722-95fc-208b7496635d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:19.108073 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4cd59b-6856-4722-95fc-208b7496635d None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:19.108294 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4cd59b-6856-4722-95fc-208b7496635d None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:19.108590 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4cd59b-6856-4722-95fc-208b7496635d None admin] PATH_INFO: `/v3/domains` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:19.109209 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4cd59b-6856-4722-95fc-208b7496635d None admin] RBAC: Adding query filter params (name=Default) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:19.109506 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4cd59b-6856-4722-95fc-208b7496635d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:19.110857 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4cd59b-6856-4722-95fc-208b7496635d None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:19.119393 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6019e60b-8f13-4dcc-9c10-ee1fe51842f2 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:19.121741 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 279/559] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Oct 1 20:33:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:19.122772 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4cd59b-6856-4722-95fc-208b7496635d None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:19.153493 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61be109-78db-459b-a644-9cd31efe28d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:19.154626 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61be109-78db-459b-a644-9cd31efe28d8 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:19.154904 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61be109-78db-459b-a644-9cd31efe28d8 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:19.155186 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61be109-78db-459b-a644-9cd31efe28d8 None admin] PATH_INFO: `/v3/projects` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:19.155868 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61be109-78db-459b-a644-9cd31efe28d8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:19.156171 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61be109-78db-459b-a644-9cd31efe28d8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:19.157646 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61be109-78db-459b-a644-9cd31efe28d8 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:19.160927 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:19.171019 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 281/560] 10.222.0.23 () {56 vars in 1148 bytes} [Sat Oct 1 20:33:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:19.171838 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61be109-78db-459b-a644-9cd31efe28d8 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:19.190456 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:19.231094 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4cd59b-6856-4722-95fc-208b7496635d None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:19.265064 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19adae1d-e793-42b5-bd34-b28834770119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:19.265680 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19adae1d-e793-42b5-bd34-b28834770119 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:19.265955 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19adae1d-e793-42b5-bd34-b28834770119 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:19.266219 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19adae1d-e793-42b5-bd34-b28834770119 None admin] PATH_INFO: `/v3/users/glance` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:19.271387 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61be109-78db-459b-a644-9cd31efe28d8 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:19.273445 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19adae1d-e793-42b5-bd34-b28834770119 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:19.274902 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19adae1d-e793-42b5-bd34-b28834770119 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:19.286175 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application [None req-19adae1d-e793-42b5-bd34-b28834770119 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 01 20:33:19.286175 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:19.286175 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:19.286175 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:19.286175 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:19.286175 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:19.286175 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:19.286175 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:19.286175 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:19.286175 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:19.286175 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:19.286175 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:19.286175 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 01 20:33:19.286175 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 01 20:33:19.286175 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 01 20:33:19.286175 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 01 20:33:19.287293 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:19.287293 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:19.287293 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 01 20:33:19.287293 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 20:33:19.287293 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 01 20:33:19.287293 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 20:33:19.287293 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:19.287293 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:19.287293 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:19.287293 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:19.287293 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:19.287293 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:19.287293 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:19.287293 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:19.287293 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:19.287293 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:19.287293 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:19.287293 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:19.288390 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:19.288390 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:19.288390 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 01 20:33:19.288390 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 01 20:33:19.288390 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 01 20:33:19.288390 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 01 20:33:19.288390 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 01 20:33:19.288390 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 01 20:33:19.288390 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 01 20:33:19.288390 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:33:19.288390 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 280/561] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Oct 1 20:33:19 2022] GET /identity/v3/users/glance => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:19.288390 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19adae1d-e793-42b5-bd34-b28834770119 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:19.308798 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c379827e-8af5-4c07-a16f-a5f1e01182c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:19.309391 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c379827e-8af5-4c07-a16f-a5f1e01182c3 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:19.309665 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c379827e-8af5-4c07-a16f-a5f1e01182c3 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:19.310068 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c379827e-8af5-4c07-a16f-a5f1e01182c3 None admin] PATH_INFO: `/v3/domains` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:19.310845 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c379827e-8af5-4c07-a16f-a5f1e01182c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:19.311137 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c379827e-8af5-4c07-a16f-a5f1e01182c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:19.312501 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c379827e-8af5-4c07-a16f-a5f1e01182c3 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:19.323550 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 282/562] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Oct 1 20:33:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:19.324235 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c379827e-8af5-4c07-a16f-a5f1e01182c3 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:19.379919 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:19.385026 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19adae1d-e793-42b5-bd34-b28834770119 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:19.404760 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:19.419006 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852533ef-051a-429b-a42d-9bc26b53e46b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:19.419851 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852533ef-051a-429b-a42d-9bc26b53e46b None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:19.420125 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852533ef-051a-429b-a42d-9bc26b53e46b None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:19.420396 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852533ef-051a-429b-a42d-9bc26b53e46b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:19.424760 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c379827e-8af5-4c07-a16f-a5f1e01182c3 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:19.433037 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852533ef-051a-429b-a42d-9bc26b53e46b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:19.434504 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852533ef-051a-429b-a42d-9bc26b53e46b None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:19.446700 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application [None req-852533ef-051a-429b-a42d-9bc26b53e46b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 01 20:33:19.446700 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:19.446700 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:19.446700 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:19.446700 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:19.446700 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:19.446700 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:19.446700 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:19.446700 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:19.446700 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:19.446700 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:19.446700 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:19.446700 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 01 20:33:19.446700 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 01 20:33:19.446700 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 01 20:33:19.446700 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 01 20:33:19.447745 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:19.447745 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:19.447745 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 01 20:33:19.447745 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 20:33:19.447745 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 01 20:33:19.447745 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 20:33:19.447745 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:19.447745 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:19.447745 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:19.447745 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:19.447745 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:19.447745 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:19.447745 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:19.447745 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:19.447745 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:19.447745 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:19.447745 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:19.447745 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:19.449135 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:19.449135 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:19.449135 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 01 20:33:19.449135 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 01 20:33:19.449135 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 01 20:33:19.449135 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 01 20:33:19.449135 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 01 20:33:19.449135 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 01 20:33:19.449135 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 01 20:33:19.449135 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:33:19.449135 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 281/563] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Oct 1 20:33:19 2022] GET /identity/v3/users/cinder => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:19.449135 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852533ef-051a-429b-a42d-9bc26b53e46b None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:19.466912 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d686925f-af31-4146-8ff7-6dcfd47bf436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:19.467564 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d686925f-af31-4146-8ff7-6dcfd47bf436 None admin] REQUEST_METHOD: `PUT` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:19.467837 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d686925f-af31-4146-8ff7-6dcfd47bf436 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:19.468105 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d686925f-af31-4146-8ff7-6dcfd47bf436 None admin] PATH_INFO: `/v3/projects/8f242c4eeaa04ed19dcdc8ba95b86cfb/users/b9c31d26f19d46f09e2f2e5e660234f2/roles/da1d78af3e8a425e8ce1130b079f8fce` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:19.482972 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d686925f-af31-4146-8ff7-6dcfd47bf436 None admin] RBAC: Authorizing `identity:create_grant(project_id=8f242c4eeaa04ed19dcdc8ba95b86cfb, user_id=b9c31d26f19d46f09e2f2e5e660234f2, role_id=da1d78af3e8a425e8ce1130b079f8fce)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:19.484449 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d686925f-af31-4146-8ff7-6dcfd47bf436 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:19.496625 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 283/564] 10.222.0.23 () {58 vars in 1439 bytes} [Sat Oct 1 20:33:19 2022] PUT /identity/v3/projects/8f242c4eeaa04ed19dcdc8ba95b86cfb/users/b9c31d26f19d46f09e2f2e5e660234f2/roles/da1d78af3e8a425e8ce1130b079f8fce => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 20:33:19.497455 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d686925f-af31-4146-8ff7-6dcfd47bf436 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:19.570882 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852533ef-051a-429b-a42d-9bc26b53e46b None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:19.609923 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ee0875-a5b2-4792-8153-e5b8b3007d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:19.610528 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ee0875-a5b2-4792-8153-e5b8b3007d6b None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:19.610697 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d686925f-af31-4146-8ff7-6dcfd47bf436 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:19.610816 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ee0875-a5b2-4792-8153-e5b8b3007d6b None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:19.611000 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ee0875-a5b2-4792-8153-e5b8b3007d6b None admin] PATH_INFO: `/v3/users` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:19.611746 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ee0875-a5b2-4792-8153-e5b8b3007d6b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:19.612052 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ee0875-a5b2-4792-8153-e5b8b3007d6b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:19.613553 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ee0875-a5b2-4792-8153-e5b8b3007d6b None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:19.619341 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:19.636691 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 282/565] 10.222.0.23 () {56 vars in 1137 bytes} [Sat Oct 1 20:33:19 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:19.637591 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ee0875-a5b2-4792-8153-e5b8b3007d6b None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:19.658469 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a30359-e12a-4aa1-a93f-72d96508f01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:19.659758 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a30359-e12a-4aa1-a93f-72d96508f01b None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:19.660033 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a30359-e12a-4aa1-a93f-72d96508f01b None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:19.660301 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a30359-e12a-4aa1-a93f-72d96508f01b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:19.670622 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a30359-e12a-4aa1-a93f-72d96508f01b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:19.672134 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a30359-e12a-4aa1-a93f-72d96508f01b None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:19.683513 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:19.684615 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-17a30359-e12a-4aa1-a93f-72d96508f01b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 01 20:33:19.684615 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:19.684615 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:19.684615 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:19.684615 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:19.684615 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:19.684615 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:19.684615 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:19.684615 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:19.684615 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:19.684615 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:19.684615 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:19.684615 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 01 20:33:19.684615 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 01 20:33:19.684615 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 01 20:33:19.684615 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 01 20:33:19.685791 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:19.685791 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:19.685791 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 01 20:33:19.685791 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 20:33:19.685791 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 01 20:33:19.685791 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 20:33:19.685791 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:19.685791 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:19.685791 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:19.685791 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:19.685791 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:19.685791 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:19.685791 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:19.685791 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:19.685791 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:19.685791 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:19.685791 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:19.685791 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:19.687635 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:19.687635 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:19.687635 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 01 20:33:19.687635 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 01 20:33:19.687635 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 01 20:33:19.687635 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 01 20:33:19.687635 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 01 20:33:19.687635 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 01 20:33:19.687635 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 01 20:33:19.687635 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:33:19.687635 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 284/566] 10.222.0.23 () {56 vars in 1102 bytes} [Sat Oct 1 20:33:19 2022] GET /identity/v3/users/neutron => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:19.687635 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a30359-e12a-4aa1-a93f-72d96508f01b None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:19.771242 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ee0875-a5b2-4792-8153-e5b8b3007d6b None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:19.804047 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a30359-e12a-4aa1-a93f-72d96508f01b None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:19.805120 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a523616c-77c9-4291-bdfa-6d6de2365b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:19.805726 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523616c-77c9-4291-bdfa-6d6de2365b59 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:19.805996 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523616c-77c9-4291-bdfa-6d6de2365b59 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:19.806258 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523616c-77c9-4291-bdfa-6d6de2365b59 None admin] PATH_INFO: `/v3/users` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:19.806977 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a523616c-77c9-4291-bdfa-6d6de2365b59 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:19.807268 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a523616c-77c9-4291-bdfa-6d6de2365b59 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:19.808721 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a523616c-77c9-4291-bdfa-6d6de2365b59 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:19.826828 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 283/567] 10.222.0.23 () {56 vars in 1137 bytes} [Sat Oct 1 20:33:19 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:19.829042 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a523616c-77c9-4291-bdfa-6d6de2365b59 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:19.843668 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52be98f-64d8-4981-b63c-e12ea3f8b4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:19.844293 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52be98f-64d8-4981-b63c-e12ea3f8b4f2 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:19.844597 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52be98f-64d8-4981-b63c-e12ea3f8b4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:19.844862 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52be98f-64d8-4981-b63c-e12ea3f8b4f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:19.855644 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52be98f-64d8-4981-b63c-e12ea3f8b4f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:19.857355 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52be98f-64d8-4981-b63c-e12ea3f8b4f2 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:19.871680 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-e52be98f-64d8-4981-b63c-e12ea3f8b4f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:33:19.871680 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:19.871680 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:19.871680 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:19.871680 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:19.871680 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:19.871680 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:19.871680 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:19.871680 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:19.871680 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:19.871680 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:19.871680 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:19.871680 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 20:33:19.871680 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 20:33:19.871680 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 20:33:19.871680 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 20:33:19.878131 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:19.878131 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:19.878131 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:19.878131 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:19.878131 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:19.878131 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:19.878131 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:19.878131 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:19.878131 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:19.878131 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:19.878131 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:19.878131 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:19.878131 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:19.878131 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:19.878131 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:19.878131 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:19.878131 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 20:33:19.879258 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 20:33:19.879258 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:33:19.879258 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:33:19.879258 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 285/568] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Oct 1 20:33:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:19.879258 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52be98f-64d8-4981-b63c-e12ea3f8b4f2 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:19.897076 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:19.934062 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:19.941430 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a523616c-77c9-4291-bdfa-6d6de2365b59 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:19.975508 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b9839d-df4a-4274-bc75-0d5c79327aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:19.976102 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b9839d-df4a-4274-bc75-0d5c79327aba None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:19.976374 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b9839d-df4a-4274-bc75-0d5c79327aba None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:19.976674 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b9839d-df4a-4274-bc75-0d5c79327aba None admin] PATH_INFO: `/v3/users` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:19.977382 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b9839d-df4a-4274-bc75-0d5c79327aba None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:19.977675 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b9839d-df4a-4274-bc75-0d5c79327aba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:19.979108 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b9839d-df4a-4274-bc75-0d5c79327aba None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:19.985088 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52be98f-64d8-4981-b63c-e12ea3f8b4f2 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:20.000959 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 284/569] 10.222.0.23 () {56 vars in 1139 bytes} [Sat Oct 1 20:33:19 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:20.000959 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b9839d-df4a-4274-bc75-0d5c79327aba None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:20.028322 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0536eb48-8b15-46fe-9980-84c111696f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:20.029592 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0536eb48-8b15-46fe-9980-84c111696f74 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:20.029959 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0536eb48-8b15-46fe-9980-84c111696f74 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:20.030237 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0536eb48-8b15-46fe-9980-84c111696f74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:20.041791 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0536eb48-8b15-46fe-9980-84c111696f74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:20.043783 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0536eb48-8b15-46fe-9980-84c111696f74 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:20.060769 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-0536eb48-8b15-46fe-9980-84c111696f74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:33:20.060769 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:20.060769 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:20.060769 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:20.060769 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:20.060769 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:20.060769 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:20.060769 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:20.060769 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:20.060769 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:20.060769 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:20.060769 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:20.060769 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 20:33:20.060769 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 20:33:20.060769 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 20:33:20.060769 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 20:33:20.061791 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:20.061791 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:20.061791 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:20.061791 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:20.061791 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:20.061791 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:20.061791 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:20.061791 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:20.061791 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:20.061791 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:20.061791 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:20.061791 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:20.061791 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:20.061791 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:20.061791 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:20.061791 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:20.061791 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 20:33:20.062671 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 20:33:20.062671 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:33:20.062671 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:33:20.062671 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 286/570] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Oct 1 20:33:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:20.062980 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0536eb48-8b15-46fe-9980-84c111696f74 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:20.113018 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b9839d-df4a-4274-bc75-0d5c79327aba None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:20.142699 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:20.149503 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9367fd3-8081-4023-bdd8-28046957fdd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:20.150121 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9367fd3-8081-4023-bdd8-28046957fdd6 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:20.150393 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9367fd3-8081-4023-bdd8-28046957fdd6 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:20.150658 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9367fd3-8081-4023-bdd8-28046957fdd6 None admin] PATH_INFO: `/v3/domains` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:20.151288 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9367fd3-8081-4023-bdd8-28046957fdd6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:20.151576 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9367fd3-8081-4023-bdd8-28046957fdd6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:20.152977 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9367fd3-8081-4023-bdd8-28046957fdd6 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:20.164857 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 285/571] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Oct 1 20:33:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:20.165679 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9367fd3-8081-4023-bdd8-28046957fdd6 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:20.184117 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0536eb48-8b15-46fe-9980-84c111696f74 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:20.186528 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:20.219287 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de334ee9-8f54-40ab-b952-5e030419147c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:20.219916 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de334ee9-8f54-40ab-b952-5e030419147c None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:20.220197 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de334ee9-8f54-40ab-b952-5e030419147c None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:20.220471 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de334ee9-8f54-40ab-b952-5e030419147c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:20.231571 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de334ee9-8f54-40ab-b952-5e030419147c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:20.233265 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de334ee9-8f54-40ab-b952-5e030419147c None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:20.249285 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-de334ee9-8f54-40ab-b952-5e030419147c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:33:20.249285 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:20.249285 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:20.249285 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:20.249285 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:20.249285 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:20.249285 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:20.249285 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:20.249285 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:20.249285 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:20.249285 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:20.249285 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:20.249285 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 20:33:20.249285 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 20:33:20.249285 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 20:33:20.249285 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 20:33:20.250252 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:20.250252 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:20.250252 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:20.250252 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:20.250252 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:20.250252 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:20.250252 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:20.250252 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:20.250252 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:20.250252 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:20.250252 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:20.250252 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:20.250252 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:20.250252 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:20.250252 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:20.250252 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:20.250252 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 20:33:20.251157 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 20:33:20.251157 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:33:20.251157 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:33:20.251157 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 287/572] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Oct 1 20:33:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:20.251796 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de334ee9-8f54-40ab-b952-5e030419147c None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:20.286122 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9367fd3-8081-4023-bdd8-28046957fdd6 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:20.327415 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeba01c3-5a01-4ffc-8855-3b2126b94e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:20.328022 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba01c3-5a01-4ffc-8855-3b2126b94e12 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:20.328305 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba01c3-5a01-4ffc-8855-3b2126b94e12 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:20.328621 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba01c3-5a01-4ffc-8855-3b2126b94e12 None admin] PATH_INFO: `/v3/domains` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:20.329259 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeba01c3-5a01-4ffc-8855-3b2126b94e12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:20.329564 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeba01c3-5a01-4ffc-8855-3b2126b94e12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:20.331373 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeba01c3-5a01-4ffc-8855-3b2126b94e12 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:20.350259 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 286/573] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Oct 1 20:33:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:20.350259 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeba01c3-5a01-4ffc-8855-3b2126b94e12 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:20.355894 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de334ee9-8f54-40ab-b952-5e030419147c None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:20.379460 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:20.393451 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745618e4-4a48-4d3b-8900-1e1312f2b608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:20.394003 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745618e4-4a48-4d3b-8900-1e1312f2b608 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:20.394560 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745618e4-4a48-4d3b-8900-1e1312f2b608 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:20.394687 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745618e4-4a48-4d3b-8900-1e1312f2b608 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:20.403101 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745618e4-4a48-4d3b-8900-1e1312f2b608 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:20.404694 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745618e4-4a48-4d3b-8900-1e1312f2b608 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:20.418032 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-745618e4-4a48-4d3b-8900-1e1312f2b608 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 20:33:20.418032 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:20.418032 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:20.418032 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:20.418032 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:20.418032 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:20.418032 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:20.418032 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:20.418032 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:20.418032 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:20.418032 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:20.418032 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:20.418032 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 01 20:33:20.418032 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 01 20:33:20.418032 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 01 20:33:20.419738 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 01 20:33:20.419738 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:20.419738 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:20.419738 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:20.419738 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:20.419738 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:20.419738 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:20.419738 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:20.419738 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:20.419738 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:20.419738 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:20.419738 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:20.419738 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:20.419738 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:20.419738 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:20.419738 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:20.419738 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:20.420705 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 01 20:33:20.420705 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 01 20:33:20.420705 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 01 20:33:20.420705 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 01 20:33:20.420705 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 01 20:33:20.420705 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 01 20:33:20.420705 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 20:33:20.420705 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:33:20.420705 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 288/574] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Oct 1 20:33:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:20.420705 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745618e4-4a48-4d3b-8900-1e1312f2b608 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:20.438789 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:20.472908 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeba01c3-5a01-4ffc-8855-3b2126b94e12 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:20.516690 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdab706-0158-4edf-a743-e1d65fb2f3ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:20.517293 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdab706-0158-4edf-a743-e1d65fb2f3ac None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:20.517572 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdab706-0158-4edf-a743-e1d65fb2f3ac None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:20.517846 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdab706-0158-4edf-a743-e1d65fb2f3ac None admin] PATH_INFO: `/v3/domains` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:20.518478 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdab706-0158-4edf-a743-e1d65fb2f3ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:20.518781 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdab706-0158-4edf-a743-e1d65fb2f3ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:20.520149 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdab706-0158-4edf-a743-e1d65fb2f3ac None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:20.522942 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745618e4-4a48-4d3b-8900-1e1312f2b608 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:20.536059 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 287/575] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Oct 1 20:33:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:20.536059 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdab706-0158-4edf-a743-e1d65fb2f3ac None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:20.563913 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67708e13-5a21-4b82-8b19-b4409431f875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:20.564698 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67708e13-5a21-4b82-8b19-b4409431f875 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:20.564979 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67708e13-5a21-4b82-8b19-b4409431f875 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:20.565268 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67708e13-5a21-4b82-8b19-b4409431f875 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:20.573646 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67708e13-5a21-4b82-8b19-b4409431f875 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:20.575117 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67708e13-5a21-4b82-8b19-b4409431f875 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:20.587630 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-67708e13-5a21-4b82-8b19-b4409431f875 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 20:33:20.587630 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:20.587630 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:20.587630 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:20.587630 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:20.587630 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:20.587630 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:20.587630 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:20.587630 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:20.587630 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:20.587630 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:20.587630 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:20.587630 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 01 20:33:20.587630 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 01 20:33:20.587630 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 01 20:33:20.588577 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 01 20:33:20.588577 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:20.588577 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:20.588577 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:20.588577 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:20.588577 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:20.588577 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:20.588577 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:20.588577 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:20.588577 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:20.588577 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:20.588577 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:20.588577 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:20.588577 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:20.588577 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:20.588577 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:20.588577 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:20.589480 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 01 20:33:20.589480 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 01 20:33:20.589480 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 01 20:33:20.589480 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 01 20:33:20.589480 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 01 20:33:20.589480 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 01 20:33:20.589480 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 20:33:20.589480 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:33:20.593903 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 289/576] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Oct 1 20:33:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:20.594898 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67708e13-5a21-4b82-8b19-b4409431f875 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:20.639100 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:20.649158 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdab706-0158-4edf-a743-e1d65fb2f3ac None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:20.687333 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e5f5f0-a7b0-41da-b15a-30f74cf1a338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:20.687944 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e5f5f0-a7b0-41da-b15a-30f74cf1a338 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:20.688224 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e5f5f0-a7b0-41da-b15a-30f74cf1a338 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:20.688504 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e5f5f0-a7b0-41da-b15a-30f74cf1a338 None admin] PATH_INFO: `/v3/projects` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:20.689218 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e5f5f0-a7b0-41da-b15a-30f74cf1a338 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:20.689970 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e5f5f0-a7b0-41da-b15a-30f74cf1a338 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:20.691703 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e5f5f0-a7b0-41da-b15a-30f74cf1a338 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:20.694456 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:20.703709 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67708e13-5a21-4b82-8b19-b4409431f875 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:20.708115 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 288/577] 10.222.0.23 () {56 vars in 1148 bytes} [Sat Oct 1 20:33:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:20.709237 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e5f5f0-a7b0-41da-b15a-30f74cf1a338 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:20.754351 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44b301a-f4c6-41b0-9346-0da7c0346d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:20.755193 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44b301a-f4c6-41b0-9346-0da7c0346d86 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:20.755362 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44b301a-f4c6-41b0-9346-0da7c0346d86 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:20.755628 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44b301a-f4c6-41b0-9346-0da7c0346d86 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:20.762758 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44b301a-f4c6-41b0-9346-0da7c0346d86 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:20.764218 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44b301a-f4c6-41b0-9346-0da7c0346d86 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:20.776011 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-e44b301a-f4c6-41b0-9346-0da7c0346d86 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 20:33:20.776011 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:20.776011 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:20.776011 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:20.776011 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:20.776011 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:20.776011 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:20.776011 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:20.776011 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:20.776011 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:20.776011 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:20.776011 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:20.776011 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 01 20:33:20.776011 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 01 20:33:20.776011 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 01 20:33:20.777009 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 01 20:33:20.777009 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:20.777009 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:20.777009 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:20.777009 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:20.777009 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:20.777009 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:20.777009 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:20.777009 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:20.777009 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:20.777009 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:20.777009 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:20.777009 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:20.777009 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:20.777009 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:20.777009 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:20.777009 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:20.783421 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 01 20:33:20.783421 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 01 20:33:20.783421 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 01 20:33:20.783421 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 01 20:33:20.783421 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 01 20:33:20.783421 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 01 20:33:20.783421 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 20:33:20.783421 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:33:20.783421 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 290/578] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Oct 1 20:33:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:20.783421 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44b301a-f4c6-41b0-9346-0da7c0346d86 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:20.831466 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e5f5f0-a7b0-41da-b15a-30f74cf1a338 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:20.869075 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42c3cdd-2c21-4ee2-b9dc-2aff9018e986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:20.869844 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c3cdd-2c21-4ee2-b9dc-2aff9018e986 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:20.870222 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c3cdd-2c21-4ee2-b9dc-2aff9018e986 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:20.870594 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c3cdd-2c21-4ee2-b9dc-2aff9018e986 None admin] PATH_INFO: `/v3/projects` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:20.871378 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42c3cdd-2c21-4ee2-b9dc-2aff9018e986 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:20.871781 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42c3cdd-2c21-4ee2-b9dc-2aff9018e986 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:20.873531 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42c3cdd-2c21-4ee2-b9dc-2aff9018e986 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:20.885463 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 289/579] 10.222.0.23 () {56 vars in 1148 bytes} [Sat Oct 1 20:33:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:20.886333 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42c3cdd-2c21-4ee2-b9dc-2aff9018e986 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:20.898252 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44b301a-f4c6-41b0-9346-0da7c0346d86 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:20.900299 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:20.936829 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb06f990-9a96-49e4-a956-5ec27abf82bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:20.937495 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06f990-9a96-49e4-a956-5ec27abf82bf None admin] REQUEST_METHOD: `PUT` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:20.937769 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06f990-9a96-49e4-a956-5ec27abf82bf None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:20.938047 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06f990-9a96-49e4-a956-5ec27abf82bf None admin] PATH_INFO: `/v3/projects/8f242c4eeaa04ed19dcdc8ba95b86cfb/users/4029dd2379eb4f5aab7c129a94d29b0c/roles/da1d78af3e8a425e8ce1130b079f8fce` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:20.946037 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:20.955976 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb06f990-9a96-49e4-a956-5ec27abf82bf None admin] RBAC: Authorizing `identity:create_grant(project_id=8f242c4eeaa04ed19dcdc8ba95b86cfb, user_id=4029dd2379eb4f5aab7c129a94d29b0c, role_id=da1d78af3e8a425e8ce1130b079f8fce)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:20.957556 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb06f990-9a96-49e4-a956-5ec27abf82bf None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:20.972279 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 291/580] 10.222.0.23 () {58 vars in 1439 bytes} [Sat Oct 1 20:33:20 2022] PUT /identity/v3/projects/8f242c4eeaa04ed19dcdc8ba95b86cfb/users/4029dd2379eb4f5aab7c129a94d29b0c/roles/da1d78af3e8a425e8ce1130b079f8fce => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 20:33:20.981588 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb06f990-9a96-49e4-a956-5ec27abf82bf None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:21.005285 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42c3cdd-2c21-4ee2-b9dc-2aff9018e986 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:21.059783 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6607d938-8895-4226-ab98-2dd19023ea66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:21.060729 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6607d938-8895-4226-ab98-2dd19023ea66 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:21.061098 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6607d938-8895-4226-ab98-2dd19023ea66 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:21.061471 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6607d938-8895-4226-ab98-2dd19023ea66 None admin] PATH_INFO: `/v3/projects` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:21.062285 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6607d938-8895-4226-ab98-2dd19023ea66 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:21.063002 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6607d938-8895-4226-ab98-2dd19023ea66 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:21.065423 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6607d938-8895-4226-ab98-2dd19023ea66 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:21.084069 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 290/581] 10.222.0.23 () {56 vars in 1148 bytes} [Sat Oct 1 20:33:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:21.090038 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6607d938-8895-4226-ab98-2dd19023ea66 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:21.110176 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb06f990-9a96-49e4-a956-5ec27abf82bf None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:21.149859 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49a4f58-9da0-4c62-9a62-174eff68180c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:21.150996 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49a4f58-9da0-4c62-9a62-174eff68180c None admin] REQUEST_METHOD: `PUT` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:21.151571 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49a4f58-9da0-4c62-9a62-174eff68180c None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:21.152034 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49a4f58-9da0-4c62-9a62-174eff68180c None admin] PATH_INFO: `/v3/projects/8f242c4eeaa04ed19dcdc8ba95b86cfb/users/1b737fe6e9f34adf8eef1851a4a89ca6/roles/da1d78af3e8a425e8ce1130b079f8fce` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:21.177210 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49a4f58-9da0-4c62-9a62-174eff68180c None admin] RBAC: Authorizing `identity:create_grant(project_id=8f242c4eeaa04ed19dcdc8ba95b86cfb, user_id=1b737fe6e9f34adf8eef1851a4a89ca6, role_id=da1d78af3e8a425e8ce1130b079f8fce)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:21.179970 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49a4f58-9da0-4c62-9a62-174eff68180c None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:21.197417 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 292/582] 10.222.0.23 () {58 vars in 1439 bytes} [Sat Oct 1 20:33:20 2022] PUT /identity/v3/projects/8f242c4eeaa04ed19dcdc8ba95b86cfb/users/1b737fe6e9f34adf8eef1851a4a89ca6/roles/da1d78af3e8a425e8ce1130b079f8fce => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 20:33:21.226533 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6607d938-8895-4226-ab98-2dd19023ea66 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:21.244045 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:21.270033 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd710eb-4e96-472a-8eb3-2fd054ef690f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:21.270710 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd710eb-4e96-472a-8eb3-2fd054ef690f None admin] REQUEST_METHOD: `PUT` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:21.270990 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd710eb-4e96-472a-8eb3-2fd054ef690f None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:21.271267 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd710eb-4e96-472a-8eb3-2fd054ef690f None admin] PATH_INFO: `/v3/projects/8f242c4eeaa04ed19dcdc8ba95b86cfb/users/d498314742474614b90a1350359f506a/roles/da1d78af3e8a425e8ce1130b079f8fce` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:21.293605 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd710eb-4e96-472a-8eb3-2fd054ef690f None admin] RBAC: Authorizing `identity:create_grant(project_id=8f242c4eeaa04ed19dcdc8ba95b86cfb, user_id=d498314742474614b90a1350359f506a, role_id=da1d78af3e8a425e8ce1130b079f8fce)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:21.295648 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd710eb-4e96-472a-8eb3-2fd054ef690f None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:21.312027 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 291/583] 10.222.0.23 () {58 vars in 1439 bytes} [Sat Oct 1 20:33:21 2022] PUT /identity/v3/projects/8f242c4eeaa04ed19dcdc8ba95b86cfb/users/d498314742474614b90a1350359f506a/roles/da1d78af3e8a425e8ce1130b079f8fce => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 20:33:21.952092 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079edaaf-ebbf-424f-8492-d75ec29129ec None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:21.952644 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079edaaf-ebbf-424f-8492-d75ec29129ec None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:21.952644 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079edaaf-ebbf-424f-8492-d75ec29129ec None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:21.954203 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 293/584] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:33:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:33:21.959548 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36596814-de75-4241-87b5-b9fdaed37af3 None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:21.959974 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36596814-de75-4241-87b5-b9fdaed37af3 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:21.960156 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36596814-de75-4241-87b5-b9fdaed37af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:21.978787 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-36596814-de75-4241-87b5-b9fdaed37af3 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:33:21.979973 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-36596814-de75-4241-87b5-b9fdaed37af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:33:22.049200 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 292/585] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:33:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 20:33:22.377501 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079edaaf-ebbf-424f-8492-d75ec29129ec None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:22.380429 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:22.496655 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079edaaf-ebbf-424f-8492-d75ec29129ec None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:22.532774 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3d70bb-7ce8-49b5-bb84-352c71918a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:22.533403 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3d70bb-7ce8-49b5-bb84-352c71918a9b None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:22.533679 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3d70bb-7ce8-49b5-bb84-352c71918a9b None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:22.533952 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3d70bb-7ce8-49b5-bb84-352c71918a9b None admin] PATH_INFO: `/v3/roles/service` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:22.545242 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3d70bb-7ce8-49b5-bb84-352c71918a9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 20:33:22.550140 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-dd3d70bb-7ce8-49b5-bb84-352c71918a9b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 01 20:33:22.550140 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:22.550140 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:22.550140 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:22.550140 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:22.550140 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:22.550140 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:22.550140 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:22.550140 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:22.550140 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:22.550140 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:22.550140 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:22.550140 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 20:33:22.550140 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 20:33:22.550140 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 20:33:22.550140 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 20:33:22.551089 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 20:33:22.551089 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 20:33:22.551089 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 20:33:22.551089 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 20:33:22.551089 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:22.551089 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:22.551089 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:22.551089 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:22.551089 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:22.551089 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:22.551089 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:22.551089 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:22.551089 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:22.551089 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:22.551089 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:22.551089 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:22.551931 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:22.551931 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:22.551931 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:22.551931 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:22.551931 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 20:33:22.551931 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 20:33:22.551931 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 20:33:22.551931 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 20:33:22.551931 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 20:33:22.551931 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 20:33:22.551931 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 01 20:33:22.551931 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:33:22.551931 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 294/586] 10.222.0.23 () {56 vars in 1102 bytes} [Sat Oct 1 20:33:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:22.557121 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36596814-de75-4241-87b5-b9fdaed37af3 None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:22.654597 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:22.663069 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36596814-de75-4241-87b5-b9fdaed37af3 None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:22.698419 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734d808f-a57c-4568-a85b-4da0394faaa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:22.699016 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d808f-a57c-4568-a85b-4da0394faaa7 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:22.699289 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d808f-a57c-4568-a85b-4da0394faaa7 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:22.699555 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d808f-a57c-4568-a85b-4da0394faaa7 None admin] PATH_INFO: `/v3/roles` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:22.700205 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734d808f-a57c-4568-a85b-4da0394faaa7 None admin] RBAC: Adding query filter params (name=service) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:22.701154 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734d808f-a57c-4568-a85b-4da0394faaa7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:22.702648 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734d808f-a57c-4568-a85b-4da0394faaa7 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:22.711116 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 293/587] 10.222.0.23 () {56 vars in 1103 bytes} [Sat Oct 1 20:33:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:22.716724 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3d70bb-7ce8-49b5-bb84-352c71918a9b None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:22.796918 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:22.830329 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3d70bb-7ce8-49b5-bb84-352c71918a9b None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:22.864710 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad445a1-27a0-4660-8352-113865246d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:22.865329 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad445a1-27a0-4660-8352-113865246d49 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:22.865602 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad445a1-27a0-4660-8352-113865246d49 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:22.865906 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad445a1-27a0-4660-8352-113865246d49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:22.877021 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad445a1-27a0-4660-8352-113865246d49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:22.878523 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad445a1-27a0-4660-8352-113865246d49 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:22.893005 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-7ad445a1-27a0-4660-8352-113865246d49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:33:22.893005 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:22.893005 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:22.893005 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:22.893005 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:22.893005 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:22.893005 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:22.893005 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:22.893005 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:22.893005 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:22.893005 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:22.893005 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:22.893005 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 20:33:22.893005 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 20:33:22.893005 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 20:33:22.893005 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 20:33:22.893951 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:22.893951 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:22.893951 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:22.893951 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:22.893951 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:22.893951 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:22.893951 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:22.893951 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:22.893951 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:22.893951 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:22.893951 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:22.893951 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:22.893951 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:22.893951 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:22.893951 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:22.893951 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:22.893951 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 20:33:22.894858 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 20:33:22.894858 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:33:22.894858 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:33:22.894858 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 295/588] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Oct 1 20:33:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:22.899678 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734d808f-a57c-4568-a85b-4da0394faaa7 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:23.003897 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734d808f-a57c-4568-a85b-4da0394faaa7 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:23.044885 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d39991-4c6e-4901-8791-439fa22084a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:23.045863 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d39991-4c6e-4901-8791-439fa22084a1 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:23.046702 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d39991-4c6e-4901-8791-439fa22084a1 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:23.047657 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d39991-4c6e-4901-8791-439fa22084a1 None admin] PATH_INFO: `/v3/domains` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:23.048685 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d39991-4c6e-4901-8791-439fa22084a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:23.049211 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d39991-4c6e-4901-8791-439fa22084a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:23.050793 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d39991-4c6e-4901-8791-439fa22084a1 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:23.066340 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 294/589] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Oct 1 20:33:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:23.076563 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad445a1-27a0-4660-8352-113865246d49 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:23.185409 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad445a1-27a0-4660-8352-113865246d49 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:23.199916 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:23.225482 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dbff69-fef8-4423-af06-2b65f3f17224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:23.226101 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dbff69-fef8-4423-af06-2b65f3f17224 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:23.226375 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dbff69-fef8-4423-af06-2b65f3f17224 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:23.226642 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dbff69-fef8-4423-af06-2b65f3f17224 None admin] PATH_INFO: `/v3/users/nova` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:23.235007 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dbff69-fef8-4423-af06-2b65f3f17224 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:23.236431 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dbff69-fef8-4423-af06-2b65f3f17224 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:23.247888 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-83dbff69-fef8-4423-af06-2b65f3f17224 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 01 20:33:23.247888 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:23.247888 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:23.247888 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:23.247888 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:23.247888 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:23.247888 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:23.247888 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:23.247888 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:23.247888 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:23.247888 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:23.247888 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:23.247888 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 01 20:33:23.247888 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 01 20:33:23.247888 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 01 20:33:23.247888 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 01 20:33:23.249142 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:23.249142 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:23.249142 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 01 20:33:23.249142 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 20:33:23.249142 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 01 20:33:23.249142 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 20:33:23.249142 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:23.249142 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:23.249142 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:23.249142 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:23.249142 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:23.249142 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:23.249142 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:23.249142 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:23.249142 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:23.249142 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:23.249142 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:23.249142 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:23.250365 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:23.250365 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:23.250365 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 01 20:33:23.250365 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 01 20:33:23.250365 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 01 20:33:23.250365 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 01 20:33:23.250365 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 01 20:33:23.250365 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 01 20:33:23.250365 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 01 20:33:23.250365 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:33:23.250365 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 296/590] 10.222.0.23 () {56 vars in 1093 bytes} [Sat Oct 1 20:33:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:23.254746 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d39991-4c6e-4901-8791-439fa22084a1 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:23.281590 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:23.360919 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d39991-4c6e-4901-8791-439fa22084a1 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:23.402457 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960177a8-c5c1-4df8-9faf-5c7f4cadc47a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:23.403078 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960177a8-c5c1-4df8-9faf-5c7f4cadc47a None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:23.403347 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960177a8-c5c1-4df8-9faf-5c7f4cadc47a None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:23.403722 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960177a8-c5c1-4df8-9faf-5c7f4cadc47a None admin] PATH_INFO: `/v3/users` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:23.404475 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960177a8-c5c1-4df8-9faf-5c7f4cadc47a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:23.404810 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960177a8-c5c1-4df8-9faf-5c7f4cadc47a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:23.406297 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960177a8-c5c1-4df8-9faf-5c7f4cadc47a None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:23.428055 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 295/591] 10.222.0.23 () {56 vars in 1133 bytes} [Sat Oct 1 20:33:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:23.434053 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dbff69-fef8-4423-af06-2b65f3f17224 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:23.549878 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dbff69-fef8-4423-af06-2b65f3f17224 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:23.587386 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f58342-9e73-4e70-93b7-4a148a2fb66d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:23.587991 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f58342-9e73-4e70-93b7-4a148a2fb66d None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:23.588267 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f58342-9e73-4e70-93b7-4a148a2fb66d None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:23.588551 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f58342-9e73-4e70-93b7-4a148a2fb66d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:23.602961 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a521e15-d817-4303-9224-c733a26a2827 None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:23.602961 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a521e15-d817-4303-9224-c733a26a2827 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:23.602961 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a521e15-d817-4303-9224-c733a26a2827 None None] PATH_INFO: `/` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:23.603780 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 296/592] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:33:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:33:23.609279 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d82d20-e86f-4eb0-8642-5fbc0a64e73d None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:23.609820 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d82d20-e86f-4eb0-8642-5fbc0a64e73d None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:23.610295 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d82d20-e86f-4eb0-8642-5fbc0a64e73d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:23.628972 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-03d82d20-e86f-4eb0-8642-5fbc0a64e73d None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:33:23.630477 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-03d82d20-e86f-4eb0-8642-5fbc0a64e73d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:33:23.635863 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:23.664842 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f58342-9e73-4e70-93b7-4a148a2fb66d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:23.666507 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f58342-9e73-4e70-93b7-4a148a2fb66d None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:23.710432 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 297/593] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:33:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 20:33:23.771440 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 297/594] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Oct 1 20:33:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 01 20:33:23.776663 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d82d20-e86f-4eb0-8642-5fbc0a64e73d None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:23.780843 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:23.831815 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a7954-3f11-4424-8d9f-42777afa938c None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:23.832003 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a7954-3f11-4424-8d9f-42777afa938c None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:23.832274 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a7954-3f11-4424-8d9f-42777afa938c None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:23.833744 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 298/595] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:33:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 01 20:33:23.838987 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0176c5f0-43c6-44db-b72b-01bbad8fa560 None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:23.839373 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0176c5f0-43c6-44db-b72b-01bbad8fa560 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:23.839703 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0176c5f0-43c6-44db-b72b-01bbad8fa560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:23.861174 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-0176c5f0-43c6-44db-b72b-01bbad8fa560 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:33:23.862356 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-0176c5f0-43c6-44db-b72b-01bbad8fa560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:33:23.881358 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d82d20-e86f-4eb0-8642-5fbc0a64e73d None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:23.920272 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94cb766-6376-4f6b-99ec-b208396ac53a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:23.920928 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94cb766-6376-4f6b-99ec-b208396ac53a None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:23.921204 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94cb766-6376-4f6b-99ec-b208396ac53a None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:23.921473 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94cb766-6376-4f6b-99ec-b208396ac53a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:23.931516 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94cb766-6376-4f6b-99ec-b208396ac53a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:23.932999 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94cb766-6376-4f6b-99ec-b208396ac53a None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:23.941438 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 299/596] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:33:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 01 20:33:23.943132 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab61da-6a9f-4a6a-a2cc-69ea31171395 None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:23.943502 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab61da-6a9f-4a6a-a2cc-69ea31171395 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:23.943843 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab61da-6a9f-4a6a-a2cc-69ea31171395 None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:23.945346 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 300/597] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:33:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:33:23.951169 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26486f1b-bd77-4a45-8e24-68fecd9cf4f2 None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:23.951526 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26486f1b-bd77-4a45-8e24-68fecd9cf4f2 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:23.951849 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application [None req-b94cb766-6376-4f6b-99ec-b208396ac53a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:33:23.951849 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:23.951849 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:23.951849 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:23.951849 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:23.951849 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:23.951849 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:23.951849 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:23.951849 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:23.951849 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:23.951849 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:23.951849 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:23.951849 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 20:33:23.951849 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 20:33:23.951849 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 20:33:23.951849 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 20:33:23.952796 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:23.952796 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:23.952796 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:23.952796 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:23.952796 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:23.952796 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:23.952796 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:23.952796 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:23.952796 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:23.952796 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:23.952796 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:23.952796 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:23.952796 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:23.952796 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:23.952796 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:23.952796 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:23.952796 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 20:33:23.953700 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 20:33:23.953700 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:33:23.953700 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:33:23.953868 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26486f1b-bd77-4a45-8e24-68fecd9cf4f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:23.960023 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 298/598] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Oct 1 20:33:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:23.961099 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94cb766-6376-4f6b-99ec-b208396ac53a None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:23.972565 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:23.977093 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-26486f1b-bd77-4a45-8e24-68fecd9cf4f2 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:33:23.978643 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-26486f1b-bd77-4a45-8e24-68fecd9cf4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:33:24.024819 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:24.061407 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 301/599] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:33:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 01 20:33:24.062090 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26486f1b-bd77-4a45-8e24-68fecd9cf4f2 None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:24.079932 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94cb766-6376-4f6b-99ec-b208396ac53a None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:24.116730 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3251ec8b-9511-4aa4-84e6-326fd32ec9e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:24.117876 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251ec8b-9511-4aa4-84e6-326fd32ec9e6 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:24.118376 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251ec8b-9511-4aa4-84e6-326fd32ec9e6 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:24.118849 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251ec8b-9511-4aa4-84e6-326fd32ec9e6 None admin] PATH_INFO: `/v3/domains` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:24.119677 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3251ec8b-9511-4aa4-84e6-326fd32ec9e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:24.120183 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3251ec8b-9511-4aa4-84e6-326fd32ec9e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:24.121880 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3251ec8b-9511-4aa4-84e6-326fd32ec9e6 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:24.140391 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 299/600] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Oct 1 20:33:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:24.141572 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3251ec8b-9511-4aa4-84e6-326fd32ec9e6 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:24.179488 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26486f1b-bd77-4a45-8e24-68fecd9cf4f2 None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:24.219701 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83061f79-8996-4cea-ae89-8beefe38445b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:24.220325 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83061f79-8996-4cea-ae89-8beefe38445b None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:24.220629 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83061f79-8996-4cea-ae89-8beefe38445b None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:24.220899 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83061f79-8996-4cea-ae89-8beefe38445b None admin] PATH_INFO: `/v3/roles/service` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:24.223477 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:24.233687 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83061f79-8996-4cea-ae89-8beefe38445b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 20:33:24.239321 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-83061f79-8996-4cea-ae89-8beefe38445b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 01 20:33:24.239321 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:24.239321 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:24.239321 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:24.239321 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:24.239321 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:24.239321 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:24.239321 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:24.239321 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:24.239321 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:24.239321 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:24.239321 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:24.239321 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 20:33:24.239321 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 20:33:24.239321 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 20:33:24.239321 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 20:33:24.240324 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 20:33:24.240324 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 20:33:24.240324 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 20:33:24.240324 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 20:33:24.240324 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:24.240324 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:24.240324 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:24.240324 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:24.240324 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:24.240324 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:24.240324 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:24.240324 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:24.240324 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:24.240324 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:24.240324 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:24.240324 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:24.241238 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:24.241238 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:24.241238 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:24.241238 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:24.241238 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 20:33:24.241238 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 20:33:24.241238 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 20:33:24.241238 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 20:33:24.241238 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 20:33:24.241238 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 20:33:24.241238 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 01 20:33:24.241238 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:33:24.245036 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 302/601] 10.222.0.23 () {56 vars in 1102 bytes} [Sat Oct 1 20:33:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:24.246137 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83061f79-8996-4cea-ae89-8beefe38445b None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:24.264679 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3251ec8b-9511-4aa4-84e6-326fd32ec9e6 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:24.283296 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:24.303103 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a1051-514e-48ed-9f6c-bd8c2562defc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:24.304032 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a1051-514e-48ed-9f6c-bd8c2562defc None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:24.304462 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a1051-514e-48ed-9f6c-bd8c2562defc None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:24.304767 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a1051-514e-48ed-9f6c-bd8c2562defc None admin] PATH_INFO: `/v3/projects/service` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:24.311902 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758a1051-514e-48ed-9f6c-bd8c2562defc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:24.313374 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758a1051-514e-48ed-9f6c-bd8c2562defc None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:24.324851 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application [None req-758a1051-514e-48ed-9f6c-bd8c2562defc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 20:33:24.324851 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:24.324851 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:24.324851 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:24.324851 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:24.324851 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:24.324851 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:24.324851 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:24.324851 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:24.324851 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:24.324851 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:24.324851 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:24.324851 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 01 20:33:24.324851 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 01 20:33:24.324851 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 01 20:33:24.326563 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 01 20:33:24.326563 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:24.326563 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:24.326563 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:24.326563 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:24.326563 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:24.326563 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:24.326563 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:24.326563 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:24.326563 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:24.326563 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:24.326563 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:24.326563 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:24.326563 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:24.326563 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:24.326563 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:24.326563 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:24.327485 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 01 20:33:24.327485 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 01 20:33:24.327485 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 01 20:33:24.327485 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 01 20:33:24.327485 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 01 20:33:24.327485 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 01 20:33:24.327485 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 20:33:24.327485 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:33:24.331275 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 300/602] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Oct 1 20:33:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:24.332403 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a1051-514e-48ed-9f6c-bd8c2562defc None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:24.355935 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83061f79-8996-4cea-ae89-8beefe38445b None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:24.394256 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ac1cd3-2be1-4661-ae94-f3e0b57367d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:24.394786 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac1cd3-2be1-4661-ae94-f3e0b57367d5 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:24.395062 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac1cd3-2be1-4661-ae94-f3e0b57367d5 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:24.395336 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac1cd3-2be1-4661-ae94-f3e0b57367d5 None admin] PATH_INFO: `/v3/roles` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:24.396010 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ac1cd3-2be1-4661-ae94-f3e0b57367d5 None admin] RBAC: Adding query filter params (name=service) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:24.396297 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ac1cd3-2be1-4661-ae94-f3e0b57367d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:24.397690 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ac1cd3-2be1-4661-ae94-f3e0b57367d5 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:24.405468 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 303/603] 10.222.0.23 () {56 vars in 1103 bytes} [Sat Oct 1 20:33:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 20:33:24.406440 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ac1cd3-2be1-4661-ae94-f3e0b57367d5 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:24.434078 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a1051-514e-48ed-9f6c-bd8c2562defc None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:24.463410 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:24.468022 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d9375-e6a9-4cd0-9d7a-1a7c012f84d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:24.468662 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d9375-e6a9-4cd0-9d7a-1a7c012f84d5 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:24.468934 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d9375-e6a9-4cd0-9d7a-1a7c012f84d5 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:24.469201 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d9375-e6a9-4cd0-9d7a-1a7c012f84d5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:24.479395 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260d9375-e6a9-4cd0-9d7a-1a7c012f84d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 20:33:24.484753 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application [None req-260d9375-e6a9-4cd0-9d7a-1a7c012f84d5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 01 20:33:24.484753 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:24.484753 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:24.484753 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:24.484753 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:24.484753 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:24.484753 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:24.484753 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:24.484753 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:24.484753 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:24.484753 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:24.484753 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:24.484753 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 20:33:24.484753 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 20:33:24.484753 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 20:33:24.484753 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 20:33:24.485728 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 20:33:24.485728 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 20:33:24.485728 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 20:33:24.485728 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 20:33:24.485728 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:24.485728 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:24.485728 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:24.485728 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:24.485728 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:24.485728 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:24.485728 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:24.485728 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:24.485728 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:24.485728 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:24.485728 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:24.485728 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:24.486577 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:24.486577 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:24.486577 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:24.486577 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:24.486577 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 20:33:24.486577 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 20:33:24.486577 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 20:33:24.486577 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 20:33:24.486577 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 20:33:24.486577 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 20:33:24.486577 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 01 20:33:24.486577 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:33:24.486577 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 301/604] 10.222.0.23 () {56 vars in 1102 bytes} [Sat Oct 1 20:33:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:24.486577 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d9375-e6a9-4cd0-9d7a-1a7c012f84d5 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:24.509732 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ac1cd3-2be1-4661-ae94-f3e0b57367d5 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:24.521847 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:24.546653 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a043ed9-0066-475b-afba-b9f6c87ac55e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:24.547253 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a043ed9-0066-475b-afba-b9f6c87ac55e None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:24.547539 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a043ed9-0066-475b-afba-b9f6c87ac55e None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:24.547810 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a043ed9-0066-475b-afba-b9f6c87ac55e None admin] PATH_INFO: `/v3/projects` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:24.548495 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a043ed9-0066-475b-afba-b9f6c87ac55e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:24.548826 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a043ed9-0066-475b-afba-b9f6c87ac55e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:24.550268 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a043ed9-0066-475b-afba-b9f6c87ac55e None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:24.562701 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 304/605] 10.222.0.23 () {56 vars in 1148 bytes} [Sat Oct 1 20:33:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:24.564053 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a043ed9-0066-475b-afba-b9f6c87ac55e None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:24.586916 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d9375-e6a9-4cd0-9d7a-1a7c012f84d5 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:24.620260 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33922d50-8683-426c-bd69-ff6121fb7560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:24.620917 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33922d50-8683-426c-bd69-ff6121fb7560 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:24.621195 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33922d50-8683-426c-bd69-ff6121fb7560 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:24.621466 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33922d50-8683-426c-bd69-ff6121fb7560 None admin] PATH_INFO: `/v3/roles/service` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:24.631907 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33922d50-8683-426c-bd69-ff6121fb7560 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 20:33:24.637142 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application [None req-33922d50-8683-426c-bd69-ff6121fb7560 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 01 20:33:24.637142 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:24.637142 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:24.637142 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:24.637142 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:24.637142 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:24.637142 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:24.637142 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:24.637142 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:24.637142 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:24.637142 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:24.637142 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:24.637142 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 20:33:24.637142 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 20:33:24.637142 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 20:33:24.637142 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 20:33:24.638796 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 20:33:24.638796 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 20:33:24.638796 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 20:33:24.638796 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 20:33:24.638796 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:24.638796 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:24.638796 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:24.638796 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:24.638796 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:24.638796 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:24.638796 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:24.638796 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:24.638796 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:24.638796 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:24.638796 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:24.638796 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:24.639644 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:24.639644 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:24.639644 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:24.639644 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:24.639644 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 20:33:24.639644 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 20:33:24.639644 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 20:33:24.639644 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 20:33:24.639644 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 20:33:24.639644 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 20:33:24.639644 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 01 20:33:24.639644 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:33:24.639644 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 302/606] 10.222.0.23 () {56 vars in 1102 bytes} [Sat Oct 1 20:33:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:24.640333 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33922d50-8683-426c-bd69-ff6121fb7560 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:24.668869 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a043ed9-0066-475b-afba-b9f6c87ac55e None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:24.686405 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:24.705792 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e71714-1e9c-4d7b-bffc-8f4c436a8054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:24.706495 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e71714-1e9c-4d7b-bffc-8f4c436a8054 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:24.706780 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e71714-1e9c-4d7b-bffc-8f4c436a8054 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:24.707054 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e71714-1e9c-4d7b-bffc-8f4c436a8054 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:24.717702 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e71714-1e9c-4d7b-bffc-8f4c436a8054 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:24.719153 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e71714-1e9c-4d7b-bffc-8f4c436a8054 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:24.732762 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:24.735176 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-d0e71714-1e9c-4d7b-bffc-8f4c436a8054 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:33:24.735176 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:24.735176 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:24.735176 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:24.735176 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:24.735176 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:24.735176 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:24.735176 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:24.735176 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:24.735176 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:24.735176 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:24.735176 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:24.735176 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 20:33:24.735176 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 20:33:24.735176 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 20:33:24.735176 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 20:33:24.736270 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:24.736270 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:24.736270 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:24.736270 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:24.736270 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:24.736270 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:24.736270 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:24.736270 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:24.736270 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:24.736270 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:24.736270 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:24.736270 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:24.736270 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:24.736270 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:24.736270 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:24.736270 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:24.736270 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 20:33:24.737377 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 20:33:24.737377 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:33:24.737377 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:33:24.737377 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 305/607] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Oct 1 20:33:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:24.737377 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e71714-1e9c-4d7b-bffc-8f4c436a8054 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:24.743904 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33922d50-8683-426c-bd69-ff6121fb7560 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:24.779967 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aec240c-2501-4668-999e-1a2671b31c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:24.780592 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec240c-2501-4668-999e-1a2671b31c89 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:24.780926 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec240c-2501-4668-999e-1a2671b31c89 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:24.781203 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec240c-2501-4668-999e-1a2671b31c89 None admin] PATH_INFO: `/v3/roles` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:24.781862 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aec240c-2501-4668-999e-1a2671b31c89 None admin] RBAC: Adding query filter params (name=service) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:24.782163 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aec240c-2501-4668-999e-1a2671b31c89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:24.783530 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aec240c-2501-4668-999e-1a2671b31c89 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:24.791257 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 303/608] 10.222.0.23 () {56 vars in 1103 bytes} [Sat Oct 1 20:33:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:24.792057 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aec240c-2501-4668-999e-1a2671b31c89 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:24.841240 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e71714-1e9c-4d7b-bffc-8f4c436a8054 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:24.878539 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2cd574-c22a-416f-ae01-2246b2aa5bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:24.879510 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2cd574-c22a-416f-ae01-2246b2aa5bb5 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:24.879849 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2cd574-c22a-416f-ae01-2246b2aa5bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:24.880216 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2cd574-c22a-416f-ae01-2246b2aa5bb5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:24.881079 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2cd574-c22a-416f-ae01-2246b2aa5bb5 None admin] RBAC: Adding query filter params (role.id=da1d78af3e8a425e8ce1130b079f8fce, scope.project.id=8f242c4eeaa04ed19dcdc8ba95b86cfb, user.id=b9c31d26f19d46f09e2f2e5e660234f2) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:24.881392 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2cd574-c22a-416f-ae01-2246b2aa5bb5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:24.883195 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2cd574-c22a-416f-ae01-2246b2aa5bb5 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:24.889757 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 306/609] 10.222.0.23 () {56 vars in 1374 bytes} [Sat Oct 1 20:33:24 2022] GET /identity/v3/role_assignments?user.id=b9c31d26f19d46f09e2f2e5e660234f2&scope.project.id=8f242c4eeaa04ed19dcdc8ba95b86cfb&role.id=da1d78af3e8a425e8ce1130b079f8fce => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:24.890845 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2cd574-c22a-416f-ae01-2246b2aa5bb5 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:24.901834 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aec240c-2501-4668-999e-1a2671b31c89 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:24.949515 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cdfd8f-63bc-400f-b66d-d8e2d2f190ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:24.950143 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cdfd8f-63bc-400f-b66d-d8e2d2f190ba None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:24.951100 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cdfd8f-63bc-400f-b66d-d8e2d2f190ba None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:24.951380 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cdfd8f-63bc-400f-b66d-d8e2d2f190ba None admin] PATH_INFO: `/v3/roles` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:24.952503 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cdfd8f-63bc-400f-b66d-d8e2d2f190ba None admin] RBAC: Adding query filter params (name=service) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:24.952837 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cdfd8f-63bc-400f-b66d-d8e2d2f190ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:24.954286 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cdfd8f-63bc-400f-b66d-d8e2d2f190ba None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:24.955791 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:24.970683 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 304/610] 10.222.0.23 () {56 vars in 1103 bytes} [Sat Oct 1 20:33:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:24.970683 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cdfd8f-63bc-400f-b66d-d8e2d2f190ba None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:25.001296 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:25.052848 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2cd574-c22a-416f-ae01-2246b2aa5bb5 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:25.092741 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df93755d-e535-46b3-9729-09345570939f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:25.093402 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df93755d-e535-46b3-9729-09345570939f None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:25.093684 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df93755d-e535-46b3-9729-09345570939f None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:25.093959 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df93755d-e535-46b3-9729-09345570939f None admin] PATH_INFO: `/v3/domains` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:25.094615 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df93755d-e535-46b3-9729-09345570939f None admin] RBAC: Adding query filter params (name=Default) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:25.094917 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df93755d-e535-46b3-9729-09345570939f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:25.097003 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df93755d-e535-46b3-9729-09345570939f None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:25.116831 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cdfd8f-63bc-400f-b66d-d8e2d2f190ba None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:25.117704 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 307/611] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Oct 1 20:33:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:25.118849 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df93755d-e535-46b3-9729-09345570939f None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:25.181781 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474210a0-fc1d-452e-938f-ab22aabe511d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:25.182648 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474210a0-fc1d-452e-938f-ab22aabe511d None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:25.182926 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474210a0-fc1d-452e-938f-ab22aabe511d None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:25.183199 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474210a0-fc1d-452e-938f-ab22aabe511d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:25.203022 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474210a0-fc1d-452e-938f-ab22aabe511d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:25.203496 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474210a0-fc1d-452e-938f-ab22aabe511d None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:25.219740 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application [None req-474210a0-fc1d-452e-938f-ab22aabe511d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:33:25.219740 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:25.219740 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:25.219740 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:25.219740 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:25.219740 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:25.219740 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:25.219740 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:25.219740 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:25.219740 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:25.219740 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:25.219740 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:25.219740 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 20:33:25.219740 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 20:33:25.219740 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 20:33:25.219740 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 20:33:25.220871 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:25.220871 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:25.220871 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:25.220871 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:25.220871 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:25.220871 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:25.220871 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:25.220871 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:25.220871 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:25.220871 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:25.220871 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:25.220871 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:25.220871 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:25.220871 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:25.220871 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:25.220871 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:25.220871 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 20:33:25.225636 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 20:33:25.225636 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:33:25.225636 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:33:25.225636 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 305/612] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Oct 1 20:33:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:25.225636 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474210a0-fc1d-452e-938f-ab22aabe511d None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:25.259251 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:25.272958 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df93755d-e535-46b3-9729-09345570939f None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:25.307046 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:25.311167 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d2a554-08ce-4b42-a9b7-b0661db07043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:25.311899 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d2a554-08ce-4b42-a9b7-b0661db07043 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:25.312243 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d2a554-08ce-4b42-a9b7-b0661db07043 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:25.312612 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d2a554-08ce-4b42-a9b7-b0661db07043 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:25.323106 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d2a554-08ce-4b42-a9b7-b0661db07043 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:25.324652 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d2a554-08ce-4b42-a9b7-b0661db07043 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:25.340301 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-55d2a554-08ce-4b42-a9b7-b0661db07043 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:33:25.340301 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:25.340301 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:25.340301 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:25.340301 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:25.340301 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:25.340301 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:25.340301 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:25.340301 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:25.340301 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:25.340301 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:25.340301 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:25.340301 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 20:33:25.340301 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 20:33:25.340301 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 20:33:25.340301 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 20:33:25.341558 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:25.341558 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:25.341558 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:25.341558 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:25.341558 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:25.341558 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:25.341558 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:25.341558 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:25.341558 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:25.341558 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:25.341558 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:25.341558 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:25.341558 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:25.341558 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:25.341558 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:25.341558 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:25.341558 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 20:33:25.342630 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 20:33:25.342630 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:33:25.342630 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:33:25.342835 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474210a0-fc1d-452e-938f-ab22aabe511d None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:25.343337 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 308/613] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Oct 1 20:33:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:25.344199 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d2a554-08ce-4b42-a9b7-b0661db07043 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:25.382268 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983354e9-6f06-4a7a-994a-e6dcd8509223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:25.382990 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983354e9-6f06-4a7a-994a-e6dcd8509223 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:25.383339 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983354e9-6f06-4a7a-994a-e6dcd8509223 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:25.383711 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983354e9-6f06-4a7a-994a-e6dcd8509223 None admin] PATH_INFO: `/v3/users/glance` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:25.391661 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983354e9-6f06-4a7a-994a-e6dcd8509223 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:25.393243 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983354e9-6f06-4a7a-994a-e6dcd8509223 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:25.405430 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application [None req-983354e9-6f06-4a7a-994a-e6dcd8509223 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 01 20:33:25.405430 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:25.405430 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:25.405430 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:25.405430 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:25.405430 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:25.405430 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:25.405430 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:25.405430 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:25.405430 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:25.405430 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:25.405430 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:25.405430 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 01 20:33:25.405430 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 01 20:33:25.405430 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 01 20:33:25.405430 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 01 20:33:25.406394 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:25.406394 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:25.406394 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 01 20:33:25.406394 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 20:33:25.406394 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 01 20:33:25.406394 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 20:33:25.406394 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:25.406394 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:25.406394 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:25.406394 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:25.406394 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:25.406394 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:25.406394 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:25.406394 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:25.406394 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:25.406394 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:25.406394 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:25.406394 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:25.407360 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:25.407360 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:25.407360 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 01 20:33:25.407360 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 01 20:33:25.407360 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 01 20:33:25.407360 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 01 20:33:25.407360 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 01 20:33:25.407360 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 01 20:33:25.407360 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 01 20:33:25.407360 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:33:25.407360 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 306/614] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Oct 1 20:33:25 2022] GET /identity/v3/users/glance => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:25.407360 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983354e9-6f06-4a7a-994a-e6dcd8509223 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:25.463323 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d2a554-08ce-4b42-a9b7-b0661db07043 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:25.505777 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ffceab-afd9-49d3-acf4-1b2e5c0b7d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:25.506495 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ffceab-afd9-49d3-acf4-1b2e5c0b7d5c None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:25.506745 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ffceab-afd9-49d3-acf4-1b2e5c0b7d5c None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:25.506936 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ffceab-afd9-49d3-acf4-1b2e5c0b7d5c None admin] PATH_INFO: `/v3/domains` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:25.507563 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ffceab-afd9-49d3-acf4-1b2e5c0b7d5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:25.507968 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ffceab-afd9-49d3-acf4-1b2e5c0b7d5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:25.509273 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ffceab-afd9-49d3-acf4-1b2e5c0b7d5c None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:25.522498 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 309/615] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Oct 1 20:33:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:25.524749 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983354e9-6f06-4a7a-994a-e6dcd8509223 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:25.525489 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ffceab-afd9-49d3-acf4-1b2e5c0b7d5c None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:25.531144 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:25.559775 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:25.565884 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5573d9e4-40e8-4cc4-a0bf-f219e1ce87ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:25.566892 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5573d9e4-40e8-4cc4-a0bf-f219e1ce87ad None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:25.566892 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5573d9e4-40e8-4cc4-a0bf-f219e1ce87ad None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:25.567097 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5573d9e4-40e8-4cc4-a0bf-f219e1ce87ad None admin] PATH_INFO: `/v3/domains` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:25.567916 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5573d9e4-40e8-4cc4-a0bf-f219e1ce87ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:25.568222 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5573d9e4-40e8-4cc4-a0bf-f219e1ce87ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:25.569632 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5573d9e4-40e8-4cc4-a0bf-f219e1ce87ad None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:25.582558 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 307/616] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Oct 1 20:33:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:25.585459 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5573d9e4-40e8-4cc4-a0bf-f219e1ce87ad None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:25.636620 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ffceab-afd9-49d3-acf4-1b2e5c0b7d5c None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:25.674013 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda14e8e-4bf0-42b7-a8b4-0c29e7a582eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:25.674753 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda14e8e-4bf0-42b7-a8b4-0c29e7a582eb None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:25.674892 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda14e8e-4bf0-42b7-a8b4-0c29e7a582eb None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:25.675145 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda14e8e-4bf0-42b7-a8b4-0c29e7a582eb None admin] PATH_INFO: `/v3/users` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:25.675864 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda14e8e-4bf0-42b7-a8b4-0c29e7a582eb None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:25.676162 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda14e8e-4bf0-42b7-a8b4-0c29e7a582eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:25.677616 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda14e8e-4bf0-42b7-a8b4-0c29e7a582eb None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:25.690662 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5573d9e4-40e8-4cc4-a0bf-f219e1ce87ad None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:25.695942 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 310/617] 10.222.0.23 () {56 vars in 1137 bytes} [Sat Oct 1 20:33:25 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:25.697464 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda14e8e-4bf0-42b7-a8b4-0c29e7a582eb None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:25.728018 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac1a511-13c0-4fde-8010-7ab0ab741463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:25.728599 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac1a511-13c0-4fde-8010-7ab0ab741463 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:25.728875 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac1a511-13c0-4fde-8010-7ab0ab741463 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:25.729134 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac1a511-13c0-4fde-8010-7ab0ab741463 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:25.738747 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac1a511-13c0-4fde-8010-7ab0ab741463 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:25.740213 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac1a511-13c0-4fde-8010-7ab0ab741463 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:25.753439 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application [None req-4ac1a511-13c0-4fde-8010-7ab0ab741463 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 01 20:33:25.753439 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:25.753439 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:25.753439 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:25.753439 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:25.753439 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:25.753439 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:25.753439 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:25.753439 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:25.753439 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:25.753439 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:25.753439 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:25.753439 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 01 20:33:25.753439 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 01 20:33:25.753439 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 01 20:33:25.753439 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 01 20:33:25.754434 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:25.754434 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:25.754434 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 01 20:33:25.754434 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 20:33:25.754434 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 01 20:33:25.754434 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 20:33:25.754434 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:25.754434 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:25.754434 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:25.754434 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:25.754434 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:25.754434 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:25.754434 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:25.754434 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:25.754434 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:25.754434 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:25.754434 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:25.754434 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:25.756048 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:25.756048 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:25.756048 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 01 20:33:25.756048 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 01 20:33:25.756048 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 01 20:33:25.756048 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 01 20:33:25.756048 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 01 20:33:25.756048 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 01 20:33:25.756048 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 01 20:33:25.756048 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:33:25.756048 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 308/618] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Oct 1 20:33:25 2022] GET /identity/v3/users/cinder => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:25.756048 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac1a511-13c0-4fde-8010-7ab0ab741463 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:25.769064 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:25.813186 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda14e8e-4bf0-42b7-a8b4-0c29e7a582eb None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:25.814415 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:25.849989 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6033a2d5-a31a-4923-989d-275409191e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:25.850617 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6033a2d5-a31a-4923-989d-275409191e77 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:25.850893 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6033a2d5-a31a-4923-989d-275409191e77 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:25.851166 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6033a2d5-a31a-4923-989d-275409191e77 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:25.858549 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6033a2d5-a31a-4923-989d-275409191e77 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:25.859989 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6033a2d5-a31a-4923-989d-275409191e77 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:25.864421 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac1a511-13c0-4fde-8010-7ab0ab741463 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:25.872891 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-6033a2d5-a31a-4923-989d-275409191e77 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 01 20:33:25.872891 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:25.872891 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:25.872891 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:25.872891 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:25.872891 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:25.872891 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:25.872891 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:25.872891 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:25.872891 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:25.872891 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:25.872891 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:25.872891 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 01 20:33:25.872891 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 01 20:33:25.872891 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 01 20:33:25.872891 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 01 20:33:25.874101 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:25.874101 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:25.874101 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 01 20:33:25.874101 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 20:33:25.874101 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 01 20:33:25.874101 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 20:33:25.874101 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:25.874101 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:25.874101 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:25.874101 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:25.874101 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:25.874101 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:25.874101 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:25.874101 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:25.874101 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:25.874101 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:25.874101 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:25.874101 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:25.875043 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:25.875043 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:25.875043 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 01 20:33:25.875043 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 01 20:33:25.875043 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 01 20:33:25.875043 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 01 20:33:25.875043 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 01 20:33:25.875043 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 01 20:33:25.875043 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 01 20:33:25.875043 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:33:25.875043 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 311/619] 10.222.0.23 () {56 vars in 1102 bytes} [Sat Oct 1 20:33:25 2022] GET /identity/v3/users/neutron => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:25.875043 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6033a2d5-a31a-4923-989d-275409191e77 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:25.910661 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc1bd6c-e2c0-4713-88e0-145eee282c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:25.911263 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc1bd6c-e2c0-4713-88e0-145eee282c77 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:25.911536 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc1bd6c-e2c0-4713-88e0-145eee282c77 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:25.911803 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc1bd6c-e2c0-4713-88e0-145eee282c77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:25.981873 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc1bd6c-e2c0-4713-88e0-145eee282c77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:25.983710 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc1bd6c-e2c0-4713-88e0-145eee282c77 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:25.986949 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6033a2d5-a31a-4923-989d-275409191e77 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:26.010856 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:26.025123 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975271d3-05b2-4a7c-90e8-30de21494c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:26.025781 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975271d3-05b2-4a7c-90e8-30de21494c59 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:26.026448 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975271d3-05b2-4a7c-90e8-30de21494c59 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:26.026728 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975271d3-05b2-4a7c-90e8-30de21494c59 None admin] PATH_INFO: `/v3/users` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:26.027738 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975271d3-05b2-4a7c-90e8-30de21494c59 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:26.028053 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975271d3-05b2-4a7c-90e8-30de21494c59 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:26.029610 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975271d3-05b2-4a7c-90e8-30de21494c59 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:26.037445 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:26.048760 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 312/620] 10.222.0.23 () {56 vars in 1137 bytes} [Sat Oct 1 20:33:25 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:26.054215 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975271d3-05b2-4a7c-90e8-30de21494c59 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:26.093544 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 309/621] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Oct 1 20:33:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 01 20:33:26.098121 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc1bd6c-e2c0-4713-88e0-145eee282c77 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:26.167879 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975271d3-05b2-4a7c-90e8-30de21494c59 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:26.205842 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc1bd6c-e2c0-4713-88e0-145eee282c77 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:26.208967 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161684a1-05f5-4770-977d-8b35a603be32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:26.209579 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161684a1-05f5-4770-977d-8b35a603be32 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:26.209856 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161684a1-05f5-4770-977d-8b35a603be32 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:26.210149 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161684a1-05f5-4770-977d-8b35a603be32 None admin] PATH_INFO: `/v3/users` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:26.211477 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161684a1-05f5-4770-977d-8b35a603be32 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:26.212031 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161684a1-05f5-4770-977d-8b35a603be32 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:26.214192 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161684a1-05f5-4770-977d-8b35a603be32 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:26.235310 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 313/622] 10.222.0.23 () {56 vars in 1139 bytes} [Sat Oct 1 20:33:26 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:26.236147 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161684a1-05f5-4770-977d-8b35a603be32 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:26.247484 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c64d58-5940-4ea6-adaf-92292f48b8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:26.248216 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c64d58-5940-4ea6-adaf-92292f48b8ed None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:26.248216 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c64d58-5940-4ea6-adaf-92292f48b8ed None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:26.248386 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c64d58-5940-4ea6-adaf-92292f48b8ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:26.272105 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:26.279965 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:26.330273 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c64d58-5940-4ea6-adaf-92292f48b8ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:26.331994 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c64d58-5940-4ea6-adaf-92292f48b8ed None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:26.347964 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161684a1-05f5-4770-977d-8b35a603be32 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:26.394585 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76d8ae5-d4c0-4dbb-a9d7-5a69b6da7037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:26.395716 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d8ae5-d4c0-4dbb-a9d7-5a69b6da7037 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:26.396591 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d8ae5-d4c0-4dbb-a9d7-5a69b6da7037 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:26.397147 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d8ae5-d4c0-4dbb-a9d7-5a69b6da7037 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:26.408407 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76d8ae5-d4c0-4dbb-a9d7-5a69b6da7037 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:26.410208 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76d8ae5-d4c0-4dbb-a9d7-5a69b6da7037 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:26.427227 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-c76d8ae5-d4c0-4dbb-a9d7-5a69b6da7037 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:33:26.427227 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:26.427227 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:26.427227 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:26.427227 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:26.427227 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:26.427227 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:26.427227 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:26.427227 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:26.427227 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:26.427227 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:26.427227 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:26.427227 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 20:33:26.427227 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 20:33:26.427227 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 20:33:26.427227 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 20:33:26.428206 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:26.428206 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:26.428206 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:26.428206 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:26.428206 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:26.428206 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:26.428206 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:26.428206 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:26.428206 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:26.428206 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:26.428206 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:26.428206 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:26.428206 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:26.428206 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:26.428206 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:26.428206 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:26.428206 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 20:33:26.429174 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 20:33:26.429174 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:33:26.429174 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:33:26.429174 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 314/623] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Oct 1 20:33:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:26.429174 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76d8ae5-d4c0-4dbb-a9d7-5a69b6da7037 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:26.453405 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 310/624] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Oct 1 20:33:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 01 20:33:26.453405 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c64d58-5940-4ea6-adaf-92292f48b8ed None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:26.510185 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:26.532861 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:26.552082 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76d8ae5-d4c0-4dbb-a9d7-5a69b6da7037 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:26.561113 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c64d58-5940-4ea6-adaf-92292f48b8ed None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:26.589634 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d0d2ad-0de8-44e9-b6ef-5180c9676163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:26.590342 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d0d2ad-0de8-44e9-b6ef-5180c9676163 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:26.590619 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d0d2ad-0de8-44e9-b6ef-5180c9676163 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:26.591542 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d0d2ad-0de8-44e9-b6ef-5180c9676163 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:26.595493 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dadce4-4b03-401b-9633-13e64e8224e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:26.596093 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dadce4-4b03-401b-9633-13e64e8224e3 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:26.596375 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dadce4-4b03-401b-9633-13e64e8224e3 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:26.596682 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dadce4-4b03-401b-9633-13e64e8224e3 None admin] PATH_INFO: `/v3/domains` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:26.597316 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dadce4-4b03-401b-9633-13e64e8224e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:26.597620 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dadce4-4b03-401b-9633-13e64e8224e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:26.598997 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dadce4-4b03-401b-9633-13e64e8224e3 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:26.610133 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 311/625] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Oct 1 20:33:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:26.610939 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dadce4-4b03-401b-9633-13e64e8224e3 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:26.676487 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d0d2ad-0de8-44e9-b6ef-5180c9676163 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:26.677966 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d0d2ad-0de8-44e9-b6ef-5180c9676163 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:26.722098 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dadce4-4b03-401b-9633-13e64e8224e3 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:26.735771 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:26.759484 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884830cc-19d3-4d80-9045-0092dd4d75e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:26.760107 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884830cc-19d3-4d80-9045-0092dd4d75e7 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:26.760430 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884830cc-19d3-4d80-9045-0092dd4d75e7 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:26.760754 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884830cc-19d3-4d80-9045-0092dd4d75e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:26.772393 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884830cc-19d3-4d80-9045-0092dd4d75e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:26.773877 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884830cc-19d3-4d80-9045-0092dd4d75e7 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:26.779244 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:26.789613 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application [None req-884830cc-19d3-4d80-9045-0092dd4d75e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:33:26.789613 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:26.789613 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:26.789613 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:26.789613 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:26.789613 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:26.789613 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:26.789613 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:26.789613 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:26.789613 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:26.789613 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:26.789613 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:26.789613 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 20:33:26.789613 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 20:33:26.789613 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 20:33:26.789613 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 20:33:26.790568 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:26.790568 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:26.790568 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:26.790568 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:26.790568 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:26.790568 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:26.790568 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:26.790568 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:26.790568 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:26.790568 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:26.790568 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:26.790568 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:26.790568 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:26.790568 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:26.790568 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:26.790568 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:26.790568 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 20:33:26.796631 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 20:33:26.796631 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:33:26.796631 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:33:26.796631 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 312/626] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Oct 1 20:33:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:26.796631 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884830cc-19d3-4d80-9045-0092dd4d75e7 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:26.796931 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 315/627] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Oct 1 20:33:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 01 20:33:26.797429 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d0d2ad-0de8-44e9-b6ef-5180c9676163 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:26.906553 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d0d2ad-0de8-44e9-b6ef-5180c9676163 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:26.908102 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884830cc-19d3-4d80-9045-0092dd4d75e7 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:26.943556 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c15de23-851b-4ed7-a053-e26314dd3639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:26.944175 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c15de23-851b-4ed7-a053-e26314dd3639 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:26.944441 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c15de23-851b-4ed7-a053-e26314dd3639 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:26.944735 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c15de23-851b-4ed7-a053-e26314dd3639 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:26.945093 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb4221a-8a1d-4235-bf81-80dfc7043a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:26.945695 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4221a-8a1d-4235-bf81-80dfc7043a91 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:26.945975 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4221a-8a1d-4235-bf81-80dfc7043a91 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:26.946250 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4221a-8a1d-4235-bf81-80dfc7043a91 None admin] PATH_INFO: `/v3/domains` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:26.946893 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb4221a-8a1d-4235-bf81-80dfc7043a91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:26.947194 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb4221a-8a1d-4235-bf81-80dfc7043a91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:26.948583 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb4221a-8a1d-4235-bf81-80dfc7043a91 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:26.952145 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c15de23-851b-4ed7-a053-e26314dd3639 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:26.953614 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c15de23-851b-4ed7-a053-e26314dd3639 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:26.964718 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 316/628] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Oct 1 20:33:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:26.964718 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb4221a-8a1d-4235-bf81-80dfc7043a91 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:26.972350 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application [None req-1c15de23-851b-4ed7-a053-e26314dd3639 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 20:33:26.972350 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:26.972350 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:26.972350 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:26.972350 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:26.972350 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:26.972350 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:26.972350 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:26.972350 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:26.972350 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:26.972350 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:26.972350 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:26.972350 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 01 20:33:26.972350 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 01 20:33:26.972350 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 01 20:33:26.973509 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 01 20:33:26.973509 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:26.973509 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:26.973509 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:26.973509 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:26.973509 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:26.973509 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:26.973509 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:26.973509 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:26.973509 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:26.973509 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:26.973509 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:26.973509 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:26.973509 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:26.973509 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:26.973509 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:26.973509 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:26.974489 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 01 20:33:26.974489 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 01 20:33:26.974489 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 01 20:33:26.974489 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 01 20:33:26.974489 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 01 20:33:26.974489 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 01 20:33:26.974489 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 20:33:26.974489 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:33:26.974489 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 313/629] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Oct 1 20:33:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:26.974489 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c15de23-851b-4ed7-a053-e26314dd3639 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:27.006202 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:27.025856 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:27.084930 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb4221a-8a1d-4235-bf81-80dfc7043a91 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:27.089373 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c15de23-851b-4ed7-a053-e26314dd3639 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:27.121567 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0752908-8c18-411d-b5bc-569a3f363947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:27.122501 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0752908-8c18-411d-b5bc-569a3f363947 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:27.122838 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0752908-8c18-411d-b5bc-569a3f363947 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:27.123112 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0752908-8c18-411d-b5bc-569a3f363947 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:27.124794 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cc2783-8c7d-491b-ab07-c393c00d1039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:27.125409 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc2783-8c7d-491b-ab07-c393c00d1039 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:27.125686 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc2783-8c7d-491b-ab07-c393c00d1039 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:27.125954 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc2783-8c7d-491b-ab07-c393c00d1039 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:27.132801 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cc2783-8c7d-491b-ab07-c393c00d1039 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:27.134246 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cc2783-8c7d-491b-ab07-c393c00d1039 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:27.138974 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0752908-8c18-411d-b5bc-569a3f363947 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:27.140425 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0752908-8c18-411d-b5bc-569a3f363947 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:27.146023 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application [None req-c2cc2783-8c7d-491b-ab07-c393c00d1039 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 20:33:27.146023 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:27.146023 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:27.146023 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:27.146023 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:27.146023 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:27.146023 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:27.146023 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:27.146023 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:27.146023 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:27.146023 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:27.146023 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:27.146023 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 01 20:33:27.146023 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 01 20:33:27.146023 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 01 20:33:27.146906 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 01 20:33:27.146906 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:27.146906 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:27.146906 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:27.146906 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:27.146906 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:27.146906 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:27.146906 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:27.146906 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:27.146906 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:27.146906 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:27.146906 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:27.146906 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:27.146906 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:27.146906 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:27.146906 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:27.146906 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:27.147814 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 01 20:33:27.147814 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 01 20:33:27.147814 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 01 20:33:27.147814 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 01 20:33:27.147814 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 01 20:33:27.147814 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 01 20:33:27.147814 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 20:33:27.147814 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:33:27.147814 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 314/630] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Oct 1 20:33:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:27.148305 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cc2783-8c7d-491b-ab07-c393c00d1039 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:27.160067 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-d0752908-8c18-411d-b5bc-569a3f363947 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:33:27.160067 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:27.160067 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:27.160067 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:27.160067 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:27.160067 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:27.160067 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:27.160067 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:27.160067 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:27.160067 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:27.160067 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:27.160067 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:27.160067 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 20:33:27.160067 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 20:33:27.160067 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 20:33:27.160067 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 20:33:27.161107 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:27.161107 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:27.161107 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:27.161107 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:27.161107 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:27.161107 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:27.161107 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:27.161107 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:27.161107 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:27.161107 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:27.161107 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:27.161107 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:27.161107 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:27.161107 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:27.161107 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:27.161107 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:27.161107 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 20:33:27.161988 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 20:33:27.161988 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:33:27.161988 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:33:27.164852 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 317/631] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Oct 1 20:33:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:27.166079 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0752908-8c18-411d-b5bc-569a3f363947 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:27.247685 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:27.267085 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cc2783-8c7d-491b-ab07-c393c00d1039 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:27.287049 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0752908-8c18-411d-b5bc-569a3f363947 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:27.289188 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:27.302926 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba160eb6-74d2-451c-ab24-75848d5a9f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:27.303630 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba160eb6-74d2-451c-ab24-75848d5a9f9e None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:27.303981 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba160eb6-74d2-451c-ab24-75848d5a9f9e None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:27.304333 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba160eb6-74d2-451c-ab24-75848d5a9f9e None admin] PATH_INFO: `/v3/projects` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:27.305153 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba160eb6-74d2-451c-ab24-75848d5a9f9e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:27.305560 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba160eb6-74d2-451c-ab24-75848d5a9f9e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:27.307007 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba160eb6-74d2-451c-ab24-75848d5a9f9e None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:27.325705 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 315/632] 10.222.0.23 () {56 vars in 1148 bytes} [Sat Oct 1 20:33:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:27.325705 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba160eb6-74d2-451c-ab24-75848d5a9f9e None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:27.330798 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eedca5-d18f-4ef5-8056-e709c88e2c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:27.331416 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eedca5-d18f-4ef5-8056-e709c88e2c31 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:27.331695 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eedca5-d18f-4ef5-8056-e709c88e2c31 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:27.331967 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eedca5-d18f-4ef5-8056-e709c88e2c31 None admin] PATH_INFO: `/v3/projects` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:27.333072 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eedca5-d18f-4ef5-8056-e709c88e2c31 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:27.333385 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eedca5-d18f-4ef5-8056-e709c88e2c31 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:27.335133 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eedca5-d18f-4ef5-8056-e709c88e2c31 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:27.348942 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 318/633] 10.222.0.23 () {56 vars in 1148 bytes} [Sat Oct 1 20:33:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:27.354484 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eedca5-d18f-4ef5-8056-e709c88e2c31 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:27.427303 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba160eb6-74d2-451c-ab24-75848d5a9f9e None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:27.462145 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7195e9f2-b001-4336-8235-cb60e9fa50b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:27.462335 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eedca5-d18f-4ef5-8056-e709c88e2c31 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:27.462764 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195e9f2-b001-4336-8235-cb60e9fa50b0 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:27.463042 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195e9f2-b001-4336-8235-cb60e9fa50b0 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:27.463312 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195e9f2-b001-4336-8235-cb60e9fa50b0 None admin] PATH_INFO: `/v3/domains` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:27.463942 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7195e9f2-b001-4336-8235-cb60e9fa50b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:27.464243 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7195e9f2-b001-4336-8235-cb60e9fa50b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:27.465656 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7195e9f2-b001-4336-8235-cb60e9fa50b0 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:27.476881 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 316/634] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Oct 1 20:33:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:27.477670 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7195e9f2-b001-4336-8235-cb60e9fa50b0 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:27.481375 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:27.502358 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacc9835-c9a0-47ce-87a6-01068c29c5de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:27.502954 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacc9835-c9a0-47ce-87a6-01068c29c5de None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:27.503232 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacc9835-c9a0-47ce-87a6-01068c29c5de None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:27.503503 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacc9835-c9a0-47ce-87a6-01068c29c5de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:27.504216 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacc9835-c9a0-47ce-87a6-01068c29c5de None admin] RBAC: Adding query filter params (role.id=da1d78af3e8a425e8ce1130b079f8fce, scope.project.id=8f242c4eeaa04ed19dcdc8ba95b86cfb, user.id=4029dd2379eb4f5aab7c129a94d29b0c) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:27.504533 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacc9835-c9a0-47ce-87a6-01068c29c5de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:27.505973 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacc9835-c9a0-47ce-87a6-01068c29c5de None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:27.511527 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 319/635] 10.222.0.23 () {56 vars in 1374 bytes} [Sat Oct 1 20:33:27 2022] GET /identity/v3/role_assignments?user.id=4029dd2379eb4f5aab7c129a94d29b0c&scope.project.id=8f242c4eeaa04ed19dcdc8ba95b86cfb&role.id=da1d78af3e8a425e8ce1130b079f8fce => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:27.513384 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e18d7-aa00-4f20-a1f5-d9711808e56a None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:27.513706 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e18d7-aa00-4f20-a1f5-d9711808e56a None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:27.514558 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e18d7-aa00-4f20-a1f5-d9711808e56a None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:27.515337 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 320/636] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:33:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:33:27.515962 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99e18d7-aa00-4f20-a1f5-d9711808e56a None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:27.551952 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:27.597289 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7195e9f2-b001-4336-8235-cb60e9fa50b0 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:27.635471 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db802d12-2a80-4ebc-a3bf-f0799993b18c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:27.636089 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db802d12-2a80-4ebc-a3bf-f0799993b18c None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:27.636368 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db802d12-2a80-4ebc-a3bf-f0799993b18c None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:27.636672 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db802d12-2a80-4ebc-a3bf-f0799993b18c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:27.637401 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db802d12-2a80-4ebc-a3bf-f0799993b18c None admin] RBAC: Adding query filter params (role.id=da1d78af3e8a425e8ce1130b079f8fce, scope.project.id=8f242c4eeaa04ed19dcdc8ba95b86cfb, user.id=1b737fe6e9f34adf8eef1851a4a89ca6) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:27.637810 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db802d12-2a80-4ebc-a3bf-f0799993b18c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:27.638980 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99e18d7-aa00-4f20-a1f5-d9711808e56a None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:27.639553 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db802d12-2a80-4ebc-a3bf-f0799993b18c None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:27.656903 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 317/637] 10.222.0.23 () {56 vars in 1374 bytes} [Sat Oct 1 20:33:27 2022] GET /identity/v3/role_assignments?user.id=1b737fe6e9f34adf8eef1851a4a89ca6&scope.project.id=8f242c4eeaa04ed19dcdc8ba95b86cfb&role.id=da1d78af3e8a425e8ce1130b079f8fce => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:27.658350 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2033f679-123e-46dd-ae6d-7b8b71c2a9d5 None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:27.658641 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2033f679-123e-46dd-ae6d-7b8b71c2a9d5 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:27.658912 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2033f679-123e-46dd-ae6d-7b8b71c2a9d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:27.686997 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-2033f679-123e-46dd-ae6d-7b8b71c2a9d5 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:33:27.688294 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-2033f679-123e-46dd-ae6d-7b8b71c2a9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:33:27.692760 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b2745a-8276-4d74-8109-45bf477f75ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:27.693413 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b2745a-8276-4d74-8109-45bf477f75ce None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:27.693693 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b2745a-8276-4d74-8109-45bf477f75ce None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:27.694013 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b2745a-8276-4d74-8109-45bf477f75ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:27.703820 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b2745a-8276-4d74-8109-45bf477f75ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:27.706109 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b2745a-8276-4d74-8109-45bf477f75ce None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:27.719975 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-a8b2745a-8276-4d74-8109-45bf477f75ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 20:33:27.719975 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:27.719975 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:27.719975 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:27.719975 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:27.719975 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:27.719975 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:27.719975 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:27.719975 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:27.719975 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:27.719975 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:27.719975 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:27.719975 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 01 20:33:27.719975 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 01 20:33:27.719975 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 01 20:33:27.721172 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 01 20:33:27.721172 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:27.721172 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:27.721172 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:27.721172 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:27.721172 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:27.721172 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:27.721172 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:27.721172 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:27.721172 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:27.721172 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:27.721172 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:27.721172 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:27.721172 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:27.721172 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:27.721172 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:27.721172 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:27.722350 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 01 20:33:27.722350 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 01 20:33:27.722350 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 01 20:33:27.722350 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 01 20:33:27.722350 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 01 20:33:27.722350 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 01 20:33:27.722350 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 20:33:27.722350 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:33:27.722350 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 321/638] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Oct 1 20:33:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:27.730063 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b2745a-8276-4d74-8109-45bf477f75ce None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:27.770532 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:27.776329 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 318/639] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:33:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 20:33:27.834808 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:27.852336 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b2745a-8276-4d74-8109-45bf477f75ce None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:27.894637 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f96a737-1445-49a7-b60d-35cbe2ee706e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:27.895240 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f96a737-1445-49a7-b60d-35cbe2ee706e None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:27.895514 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f96a737-1445-49a7-b60d-35cbe2ee706e None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:27.895779 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f96a737-1445-49a7-b60d-35cbe2ee706e None admin] PATH_INFO: `/v3/projects` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:27.896467 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f96a737-1445-49a7-b60d-35cbe2ee706e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:27.896837 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f96a737-1445-49a7-b60d-35cbe2ee706e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:27.898280 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f96a737-1445-49a7-b60d-35cbe2ee706e None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:27.912804 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 322/640] 10.222.0.23 () {56 vars in 1148 bytes} [Sat Oct 1 20:33:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:27.920940 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2033f679-123e-46dd-ae6d-7b8b71c2a9d5 None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:28.029505 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2033f679-123e-46dd-ae6d-7b8b71c2a9d5 None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:28.065472 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a548b46b-67c0-4b01-9aec-17885140ce08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:28.066074 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a548b46b-67c0-4b01-9aec-17885140ce08 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:28.066347 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a548b46b-67c0-4b01-9aec-17885140ce08 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:28.066618 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a548b46b-67c0-4b01-9aec-17885140ce08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:28.067327 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a548b46b-67c0-4b01-9aec-17885140ce08 None admin] RBAC: Adding query filter params (role.id=da1d78af3e8a425e8ce1130b079f8fce, scope.project.id=8f242c4eeaa04ed19dcdc8ba95b86cfb, user.id=d498314742474614b90a1350359f506a) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:28.067942 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a548b46b-67c0-4b01-9aec-17885140ce08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:28.069399 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a548b46b-67c0-4b01-9aec-17885140ce08 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:28.076158 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 319/641] 10.222.0.23 () {56 vars in 1374 bytes} [Sat Oct 1 20:33:27 2022] GET /identity/v3/role_assignments?user.id=d498314742474614b90a1350359f506a&scope.project.id=8f242c4eeaa04ed19dcdc8ba95b86cfb&role.id=da1d78af3e8a425e8ce1130b079f8fce => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:28.120508 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f96a737-1445-49a7-b60d-35cbe2ee706e None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:28.244550 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f96a737-1445-49a7-b60d-35cbe2ee706e None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:28.281012 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bbc098-4173-41bd-9afe-0f811e8cb0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:28.281670 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bbc098-4173-41bd-9afe-0f811e8cb0d2 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:28.281948 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bbc098-4173-41bd-9afe-0f811e8cb0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:28.282221 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bbc098-4173-41bd-9afe-0f811e8cb0d2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:28.295668 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bbc098-4173-41bd-9afe-0f811e8cb0d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 20:33:28.300509 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-c0bbc098-4173-41bd-9afe-0f811e8cb0d2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 20:33:28.300509 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:28.300509 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:28.300509 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:28.300509 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:28.300509 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:28.300509 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:28.300509 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:28.300509 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:28.300509 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:28.300509 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:28.300509 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:28.300509 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 20:33:28.300509 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 20:33:28.300509 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 20:33:28.300509 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 20:33:28.301727 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 20:33:28.301727 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 20:33:28.301727 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 20:33:28.301727 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 20:33:28.301727 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:28.301727 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:28.301727 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:28.301727 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:28.301727 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:28.301727 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:28.301727 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:28.301727 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:28.301727 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:28.301727 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:28.301727 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:28.301727 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:28.302813 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:28.302813 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:28.302813 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:28.302813 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:28.302813 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 20:33:28.302813 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 20:33:28.302813 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 20:33:28.302813 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 20:33:28.302813 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 20:33:28.302813 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 20:33:28.302813 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 20:33:28.302813 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:33:28.302813 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 323/642] 10.222.0.23 () {56 vars in 1096 bytes} [Sat Oct 1 20:33:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:28.310244 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a548b46b-67c0-4b01-9aec-17885140ce08 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:28.379673 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:28.423535 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a548b46b-67c0-4b01-9aec-17885140ce08 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:28.459064 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39869695-72b4-45c6-9ff0-43066cd8f370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:28.459667 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39869695-72b4-45c6-9ff0-43066cd8f370 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:28.459944 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39869695-72b4-45c6-9ff0-43066cd8f370 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:28.460212 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39869695-72b4-45c6-9ff0-43066cd8f370 None admin] PATH_INFO: `/v3/roles` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:28.460899 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39869695-72b4-45c6-9ff0-43066cd8f370 None admin] RBAC: Adding query filter params (name=admin) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:28.461201 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39869695-72b4-45c6-9ff0-43066cd8f370 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:28.462594 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39869695-72b4-45c6-9ff0-43066cd8f370 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:28.471882 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 320/643] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Oct 1 20:33:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:28.477544 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bbc098-4173-41bd-9afe-0f811e8cb0d2 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:28.487344 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:28.583296 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bbc098-4173-41bd-9afe-0f811e8cb0d2 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:28.623520 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca33c748-4c8f-4d0e-a7ed-be7ff514bf2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:28.624147 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca33c748-4c8f-4d0e-a7ed-be7ff514bf2e None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:28.624426 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca33c748-4c8f-4d0e-a7ed-be7ff514bf2e None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:28.624729 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca33c748-4c8f-4d0e-a7ed-be7ff514bf2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:28.635282 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca33c748-4c8f-4d0e-a7ed-be7ff514bf2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:28.636778 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca33c748-4c8f-4d0e-a7ed-be7ff514bf2e None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:28.652247 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-ca33c748-4c8f-4d0e-a7ed-be7ff514bf2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:33:28.652247 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:28.652247 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:28.652247 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:28.652247 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:28.652247 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:28.652247 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:28.652247 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:28.652247 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:28.652247 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:28.652247 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:28.652247 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:28.652247 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 20:33:28.652247 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 20:33:28.652247 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 20:33:28.652247 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 20:33:28.653312 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:28.653312 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:28.653312 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:28.653312 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:28.653312 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:28.653312 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:28.653312 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:28.653312 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:28.653312 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:28.653312 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:28.653312 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:28.653312 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:28.653312 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:28.653312 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:28.653312 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:28.653312 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:28.653312 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 20:33:28.654264 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 20:33:28.654264 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:33:28.654264 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:33:28.654264 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 324/644] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Oct 1 20:33:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:28.659117 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39869695-72b4-45c6-9ff0-43066cd8f370 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:28.784236 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39869695-72b4-45c6-9ff0-43066cd8f370 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:28.808256 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:28.821739 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1886de-0834-4e3d-9456-34fa928bea4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:28.822352 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1886de-0834-4e3d-9456-34fa928bea4d None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:28.822631 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1886de-0834-4e3d-9456-34fa928bea4d None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:28.822963 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1886de-0834-4e3d-9456-34fa928bea4d None admin] PATH_INFO: `/v3/domains` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:28.823610 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1886de-0834-4e3d-9456-34fa928bea4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:28.823910 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1886de-0834-4e3d-9456-34fa928bea4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:28.826264 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1886de-0834-4e3d-9456-34fa928bea4d None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:28.842236 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 321/645] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Oct 1 20:33:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:28.847734 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca33c748-4c8f-4d0e-a7ed-be7ff514bf2e None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:28.909264 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:28.958419 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca33c748-4c8f-4d0e-a7ed-be7ff514bf2e None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:28.999222 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3429d4b-d358-4326-b472-e17397081bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:29.000714 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3429d4b-d358-4326-b472-e17397081bbf None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:29.000714 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3429d4b-d358-4326-b472-e17397081bbf None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:29.000714 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3429d4b-d358-4326-b472-e17397081bbf None admin] PATH_INFO: `/v3/users/nova` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:29.009749 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3429d4b-d358-4326-b472-e17397081bbf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:29.011214 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3429d4b-d358-4326-b472-e17397081bbf None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:29.023768 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-f3429d4b-d358-4326-b472-e17397081bbf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 01 20:33:29.023768 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:29.023768 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:29.023768 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:29.023768 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:29.023768 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:29.023768 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:29.023768 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:29.023768 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:29.023768 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:29.023768 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:29.023768 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:29.023768 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 01 20:33:29.023768 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 01 20:33:29.023768 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 01 20:33:29.023768 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 01 20:33:29.024799 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:29.024799 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:29.024799 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 01 20:33:29.024799 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 20:33:29.024799 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 01 20:33:29.024799 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 20:33:29.024799 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:29.024799 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:29.024799 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:29.024799 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:29.024799 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:29.024799 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:29.024799 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:29.024799 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:29.024799 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:29.024799 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:29.024799 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:29.024799 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:29.025731 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:29.025731 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:29.025731 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 01 20:33:29.025731 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 01 20:33:29.025731 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 01 20:33:29.025731 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 01 20:33:29.025731 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 01 20:33:29.025731 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 01 20:33:29.025731 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 01 20:33:29.025731 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:33:29.025731 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 325/646] 10.222.0.23 () {56 vars in 1093 bytes} [Sat Oct 1 20:33:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:29.033660 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1886de-0834-4e3d-9456-34fa928bea4d None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:29.143678 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1886de-0834-4e3d-9456-34fa928bea4d None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:29.190160 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc72101-2452-4396-bdbe-6bbbd005ed4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:29.190768 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc72101-2452-4396-bdbe-6bbbd005ed4a None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:29.191045 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc72101-2452-4396-bdbe-6bbbd005ed4a None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:29.191315 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc72101-2452-4396-bdbe-6bbbd005ed4a None admin] PATH_INFO: `/v3/users` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:29.192038 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc72101-2452-4396-bdbe-6bbbd005ed4a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:29.192609 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc72101-2452-4396-bdbe-6bbbd005ed4a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:29.194058 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc72101-2452-4396-bdbe-6bbbd005ed4a None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:29.213168 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 322/647] 10.222.0.23 () {56 vars in 1133 bytes} [Sat Oct 1 20:33:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:29.219286 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3429d4b-d358-4326-b472-e17397081bbf None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:29.322685 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3429d4b-d358-4326-b472-e17397081bbf None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:29.342142 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:29.360161 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bb2d5b-b576-4507-bbc1-f5a58b8f6a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:29.361099 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb2d5b-b576-4507-bbc1-f5a58b8f6a0e None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:29.361583 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb2d5b-b576-4507-bbc1-f5a58b8f6a0e None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:29.362057 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb2d5b-b576-4507-bbc1-f5a58b8f6a0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:29.433938 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bb2d5b-b576-4507-bbc1-f5a58b8f6a0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:29.435888 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bb2d5b-b576-4507-bbc1-f5a58b8f6a0e None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:29.663569 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 326/648] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Oct 1 20:33:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 01 20:33:29.669405 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc72101-2452-4396-bdbe-6bbbd005ed4a None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:29.719353 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:29.784265 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc72101-2452-4396-bdbe-6bbbd005ed4a None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:29.827145 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39c9763-5b0d-4cf8-a27d-59ed43664129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:29.827776 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c9763-5b0d-4cf8-a27d-59ed43664129 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:29.828048 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c9763-5b0d-4cf8-a27d-59ed43664129 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:29.828315 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c9763-5b0d-4cf8-a27d-59ed43664129 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:29.838902 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39c9763-5b0d-4cf8-a27d-59ed43664129 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:29.840345 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39c9763-5b0d-4cf8-a27d-59ed43664129 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:29.856929 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application [None req-e39c9763-5b0d-4cf8-a27d-59ed43664129 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:33:29.856929 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:29.856929 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:29.856929 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:29.856929 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:29.856929 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:29.856929 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:29.856929 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:29.856929 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:29.856929 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:29.856929 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:29.856929 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:29.856929 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 20:33:29.856929 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 20:33:29.856929 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 20:33:29.856929 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 20:33:29.857913 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:29.857913 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:29.857913 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:29.857913 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:29.857913 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:29.857913 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:29.857913 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:29.857913 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:29.857913 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:29.857913 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:29.857913 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:29.857913 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:29.857913 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:29.857913 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:29.857913 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:29.857913 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:29.857913 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 20:33:29.858814 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 20:33:29.858814 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:33:29.858814 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:33:29.858814 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 323/649] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Oct 1 20:33:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:29.864031 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bb2d5b-b576-4507-bbc1-f5a58b8f6a0e None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:29.883771 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:29.968315 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bb2d5b-b576-4507-bbc1-f5a58b8f6a0e None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:30.003539 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873e66dc-3a33-4b41-a4df-bfb295c8d76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:30.004117 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873e66dc-3a33-4b41-a4df-bfb295c8d76e None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:30.004397 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873e66dc-3a33-4b41-a4df-bfb295c8d76e None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:30.004701 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873e66dc-3a33-4b41-a4df-bfb295c8d76e None admin] PATH_INFO: `/v3/domains` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:30.005343 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873e66dc-3a33-4b41-a4df-bfb295c8d76e None admin] RBAC: Adding query filter params (name=Default) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:30.005643 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873e66dc-3a33-4b41-a4df-bfb295c8d76e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:30.007006 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873e66dc-3a33-4b41-a4df-bfb295c8d76e None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:30.019437 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 327/650] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Oct 1 20:33:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:30.024892 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39c9763-5b0d-4cf8-a27d-59ed43664129 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:30.124106 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:30.131055 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39c9763-5b0d-4cf8-a27d-59ed43664129 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:30.167333 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a4fcae-0739-4c73-bec8-0f99094f7af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:30.167964 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4fcae-0739-4c73-bec8-0f99094f7af4 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:30.168237 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4fcae-0739-4c73-bec8-0f99094f7af4 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:30.168507 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4fcae-0739-4c73-bec8-0f99094f7af4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:30.176844 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a4fcae-0739-4c73-bec8-0f99094f7af4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:30.178297 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a4fcae-0739-4c73-bec8-0f99094f7af4 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:30.190316 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application [None req-32a4fcae-0739-4c73-bec8-0f99094f7af4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 20:33:30.190316 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:30.190316 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:30.190316 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:30.190316 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:30.190316 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:30.190316 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:30.190316 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:30.190316 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:30.190316 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:30.190316 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:30.190316 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:30.190316 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 01 20:33:30.190316 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 01 20:33:30.190316 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 01 20:33:30.192650 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 01 20:33:30.192650 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:30.192650 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:30.192650 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:30.192650 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:30.192650 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:30.192650 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:30.192650 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:30.192650 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:30.192650 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:30.192650 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:30.192650 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:30.192650 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:30.192650 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:30.192650 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:30.192650 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:30.192650 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:30.194136 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 01 20:33:30.194136 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 01 20:33:30.194136 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 01 20:33:30.194136 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 01 20:33:30.194136 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 01 20:33:30.194136 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 01 20:33:30.194136 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 20:33:30.194136 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:33:30.194136 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 324/651] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Oct 1 20:33:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:30.197578 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873e66dc-3a33-4b41-a4df-bfb295c8d76e None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:30.232345 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d470d891-d63f-405a-98e6-f360ba2a00e4 None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:30.232688 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d470d891-d63f-405a-98e6-f360ba2a00e4 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:30.232932 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d470d891-d63f-405a-98e6-f360ba2a00e4 None None] PATH_INFO: `/` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:30.234380 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 325/652] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:33:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 01 20:33:30.239708 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360f8c3e-9d90-4fe6-87fe-b6734c712bde None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:30.240035 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360f8c3e-9d90-4fe6-87fe-b6734c712bde None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:30.240308 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360f8c3e-9d90-4fe6-87fe-b6734c712bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:30.259304 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-360f8c3e-9d90-4fe6-87fe-b6734c712bde None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:33:30.260487 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-360f8c3e-9d90-4fe6-87fe-b6734c712bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:33:30.286790 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:30.311781 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873e66dc-3a33-4b41-a4df-bfb295c8d76e None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:30.330614 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 326/653] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:33:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 01 20:33:30.332722 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b5ea91-54a5-43d4-8c6c-9afdbc323ee8 None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:30.332722 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b5ea91-54a5-43d4-8c6c-9afdbc323ee8 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:30.332722 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b5ea91-54a5-43d4-8c6c-9afdbc323ee8 None None] PATH_INFO: `/` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:30.333893 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 327/654] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:33:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:33:30.341017 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f11f3-2e46-4ca4-943e-91361f8bcc8e None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:30.341017 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f11f3-2e46-4ca4-943e-91361f8bcc8e None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:30.341017 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f11f3-2e46-4ca4-943e-91361f8bcc8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:30.358019 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fc9331-8767-43ee-a1fb-f76b25d0d0f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:30.359346 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-497f11f3-2e46-4ca4-943e-91361f8bcc8e None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:33:30.359629 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fc9331-8767-43ee-a1fb-f76b25d0d0f7 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:30.360108 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fc9331-8767-43ee-a1fb-f76b25d0d0f7 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:30.360540 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-497f11f3-2e46-4ca4-943e-91361f8bcc8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:33:30.360858 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fc9331-8767-43ee-a1fb-f76b25d0d0f7 None admin] PATH_INFO: `/v3/projects` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:30.362318 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fc9331-8767-43ee-a1fb-f76b25d0d0f7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:30.363049 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fc9331-8767-43ee-a1fb-f76b25d0d0f7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:30.365941 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fc9331-8767-43ee-a1fb-f76b25d0d0f7 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:30.389484 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 328/655] 10.222.0.23 () {56 vars in 1148 bytes} [Sat Oct 1 20:33:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:30.391730 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fc9331-8767-43ee-a1fb-f76b25d0d0f7 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:30.456671 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 328/656] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:33:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 01 20:33:30.571508 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fc9331-8767-43ee-a1fb-f76b25d0d0f7 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:30.644399 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a61767-ad28-47a0-b893-f9a33d24cb7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:30.645432 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a61767-ad28-47a0-b893-f9a33d24cb7d None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:30.645906 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a61767-ad28-47a0-b893-f9a33d24cb7d None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:30.646375 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a61767-ad28-47a0-b893-f9a33d24cb7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:30.647383 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a61767-ad28-47a0-b893-f9a33d24cb7d None admin] RBAC: Adding query filter params (role.id=d11e7ba2f1fa41ff8ea8dda2a8d1466f, scope.project.id=8f242c4eeaa04ed19dcdc8ba95b86cfb, user.id=b9c31d26f19d46f09e2f2e5e660234f2) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:30.647906 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a61767-ad28-47a0-b893-f9a33d24cb7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:30.649621 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a61767-ad28-47a0-b893-f9a33d24cb7d None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:30.672976 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 329/657] 10.222.0.23 () {56 vars in 1374 bytes} [Sat Oct 1 20:33:30 2022] GET /identity/v3/role_assignments?user.id=b9c31d26f19d46f09e2f2e5e660234f2&scope.project.id=8f242c4eeaa04ed19dcdc8ba95b86cfb&role.id=d11e7ba2f1fa41ff8ea8dda2a8d1466f => generated 259 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:30.679525 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497f11f3-2e46-4ca4-943e-91361f8bcc8e None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:30.724355 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:30.818581 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a90e4-f219-489d-85ff-5cf25cec55ed None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:30.818967 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a90e4-f219-489d-85ff-5cf25cec55ed None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:30.819245 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a90e4-f219-489d-85ff-5cf25cec55ed None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:30.820786 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 330/658] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:33:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:33:30.821342 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1a90e4-f219-489d-85ff-5cf25cec55ed None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:30.828363 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:30.829784 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497f11f3-2e46-4ca4-943e-91361f8bcc8e None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:30.867444 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7951b21d-2f2f-40b4-b3eb-f8b4844004a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:30.868101 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7951b21d-2f2f-40b4-b3eb-f8b4844004a3 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:30.868371 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7951b21d-2f2f-40b4-b3eb-f8b4844004a3 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:30.868671 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7951b21d-2f2f-40b4-b3eb-f8b4844004a3 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:30.869257 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7951b21d-2f2f-40b4-b3eb-f8b4844004a3 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:30.870705 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7951b21d-2f2f-40b4-b3eb-f8b4844004a3 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:30.882156 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application [None req-7951b21d-2f2f-40b4-b3eb-f8b4844004a3 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 01 20:33:30.882156 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:30.882156 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 01 20:33:30.882156 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 01 20:33:30.882156 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 01 20:33:30.882156 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 01 20:33:30.882156 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 01 20:33:30.882156 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 01 20:33:30.882156 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 01 20:33:30.882156 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:33:30.882156 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 01 20:33:30.882156 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:33:30.882156 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:30.882156 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:30.882156 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:30.882156 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:30.882156 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:30.883241 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:30.883241 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:30.883241 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:30.883241 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:30.883241 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:30.883241 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:30.883241 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 01 20:33:30.883241 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 01 20:33:30.883241 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 01 20:33:30.883241 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 01 20:33:30.883241 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:30.883241 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:30.883241 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:30.883241 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:30.883241 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:30.883241 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:30.884099 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:30.884099 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:30.884099 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:30.884099 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:30.884099 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:30.884099 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:30.884099 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:30.884099 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:30.884099 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:30.884099 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:30.884099 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 01 20:33:30.884099 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 01 20:33:30.884099 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 01 20:33:30.884099 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:33:30.884099 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 329/659] 10.222.0.23 () {56 vars in 1129 bytes} [Sat Oct 1 20:33:30 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:30.884954 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df332cb9-756c-4e3f-bd2f-ea4839100f6a None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:30.884954 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df332cb9-756c-4e3f-bd2f-ea4839100f6a None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:30.885451 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df332cb9-756c-4e3f-bd2f-ea4839100f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:30.906754 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-df332cb9-756c-4e3f-bd2f-ea4839100f6a None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:33:30.907971 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-df332cb9-756c-4e3f-bd2f-ea4839100f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:33:30.955036 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1a90e4-f219-489d-85ff-5cf25cec55ed None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:30.981791 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 330/660] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:33:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 20:33:30.982666 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df332cb9-756c-4e3f-bd2f-ea4839100f6a None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:30.996576 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:30.999096 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1319d1b5-5260-4c42-b0fa-d5491f16b885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:31.000001 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319d1b5-5260-4c42-b0fa-d5491f16b885 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:31.000493 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319d1b5-5260-4c42-b0fa-d5491f16b885 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:31.001039 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319d1b5-5260-4c42-b0fa-d5491f16b885 None admin] PATH_INFO: `/v3/services/image` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:31.001845 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1319d1b5-5260-4c42-b0fa-d5491f16b885 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:31.004033 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1319d1b5-5260-4c42-b0fa-d5491f16b885 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:31.016270 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-1319d1b5-5260-4c42-b0fa-d5491f16b885 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 01 20:33:31.016270 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:31.016270 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 01 20:33:31.016270 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 01 20:33:31.016270 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 01 20:33:31.016270 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 01 20:33:31.016270 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 01 20:33:31.016270 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 01 20:33:31.016270 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 01 20:33:31.016270 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:33:31.016270 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 01 20:33:31.016270 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:33:31.016270 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:31.016270 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:31.016270 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:31.016270 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:31.016270 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:31.017374 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:31.017374 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:31.017374 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:31.017374 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:31.017374 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:31.017374 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:31.017374 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 01 20:33:31.017374 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 01 20:33:31.017374 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 01 20:33:31.017374 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 01 20:33:31.017374 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:31.017374 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:31.017374 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:31.017374 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:31.017374 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:31.017374 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:31.018236 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:31.018236 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:31.018236 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:31.018236 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:31.018236 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:31.018236 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:31.018236 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:31.018236 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:31.018236 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:31.018236 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:31.018236 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 01 20:33:31.018236 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 01 20:33:31.018236 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 01 20:33:31.018236 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:33:31.018236 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 331/661] 10.222.0.23 () {56 vars in 1105 bytes} [Sat Oct 1 20:33:30 2022] GET /identity/v3/services/image => generated 86 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:31.023111 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1319d1b5-5260-4c42-b0fa-d5491f16b885 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:31.094116 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:31.108016 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df332cb9-756c-4e3f-bd2f-ea4839100f6a None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:31.132955 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1319d1b5-5260-4c42-b0fa-d5491f16b885 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:31.146197 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35529d63-d003-4e00-a335-5a0a2745aa4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:31.146931 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35529d63-d003-4e00-a335-5a0a2745aa4a None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:31.147309 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35529d63-d003-4e00-a335-5a0a2745aa4a None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:31.147681 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35529d63-d003-4e00-a335-5a0a2745aa4a None admin] PATH_INFO: `/v3/services` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:31.148517 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35529d63-d003-4e00-a335-5a0a2745aa4a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:31.148827 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35529d63-d003-4e00-a335-5a0a2745aa4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:31.150294 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35529d63-d003-4e00-a335-5a0a2745aa4a None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:31.156996 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 331/662] 10.222.0.23 () {56 vars in 1124 bytes} [Sat Oct 1 20:33:30 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:31.164077 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35529d63-d003-4e00-a335-5a0a2745aa4a None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:31.181599 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0752a91-68ad-4149-992c-b571eb3288f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:31.182770 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0752a91-68ad-4149-992c-b571eb3288f8 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:31.183256 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0752a91-68ad-4149-992c-b571eb3288f8 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:31.183992 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0752a91-68ad-4149-992c-b571eb3288f8 None admin] PATH_INFO: `/v3/services` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:31.186061 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0752a91-68ad-4149-992c-b571eb3288f8 None admin] RBAC: Adding query filter params (name=image) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:31.186856 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0752a91-68ad-4149-992c-b571eb3288f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:31.189105 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0752a91-68ad-4149-992c-b571eb3288f8 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:31.204558 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 332/663] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Oct 1 20:33:31 2022] GET /identity/v3/services?name=image => generated 122 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:31.210183 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0752a91-68ad-4149-992c-b571eb3288f8 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:31.256791 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:31.290977 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35529d63-d003-4e00-a335-5a0a2745aa4a None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:31.328993 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7418ed-9a90-400c-baaa-66e4fc5bfbea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:31.329743 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7418ed-9a90-400c-baaa-66e4fc5bfbea None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:31.330344 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7418ed-9a90-400c-baaa-66e4fc5bfbea None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:31.330463 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7418ed-9a90-400c-baaa-66e4fc5bfbea None admin] PATH_INFO: `/v3/services` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:31.331117 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7418ed-9a90-400c-baaa-66e4fc5bfbea None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:31.331521 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7418ed-9a90-400c-baaa-66e4fc5bfbea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:31.332971 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7418ed-9a90-400c-baaa-66e4fc5bfbea None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:31.344637 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 332/664] 10.222.0.23 () {56 vars in 1124 bytes} [Sat Oct 1 20:33:31 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 20:33:31.344816 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0752a91-68ad-4149-992c-b571eb3288f8 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:31.344900 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7418ed-9a90-400c-baaa-66e4fc5bfbea None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:31.375188 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:31.381834 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab30b89e-923f-4e5f-93d9-f3a7840be585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:31.382592 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab30b89e-923f-4e5f-93d9-f3a7840be585 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:31.382970 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab30b89e-923f-4e5f-93d9-f3a7840be585 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:31.383339 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab30b89e-923f-4e5f-93d9-f3a7840be585 None admin] PATH_INFO: `/v3/services` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:31.384106 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab30b89e-923f-4e5f-93d9-f3a7840be585 None admin] RBAC: Adding query filter params (type=image) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:31.384584 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab30b89e-923f-4e5f-93d9-f3a7840be585 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:31.386069 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab30b89e-923f-4e5f-93d9-f3a7840be585 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:31.392835 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 333/665] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Oct 1 20:33:31 2022] GET /identity/v3/services?type=image => generated 122 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 20:33:31.479491 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7418ed-9a90-400c-baaa-66e4fc5bfbea None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:31.520969 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc1873a-28dc-4b47-84cb-1bb7a7166a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:31.521628 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc1873a-28dc-4b47-84cb-1bb7a7166a09 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:31.521905 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc1873a-28dc-4b47-84cb-1bb7a7166a09 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:31.522177 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc1873a-28dc-4b47-84cb-1bb7a7166a09 None admin] PATH_INFO: `/v3/services/network` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:31.522781 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc1873a-28dc-4b47-84cb-1bb7a7166a09 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:31.524208 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc1873a-28dc-4b47-84cb-1bb7a7166a09 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:31.527474 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:31.535975 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application [None req-abc1873a-28dc-4b47-84cb-1bb7a7166a09 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 01 20:33:31.535975 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:31.535975 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 01 20:33:31.535975 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 01 20:33:31.535975 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 01 20:33:31.535975 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 01 20:33:31.535975 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 01 20:33:31.535975 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 01 20:33:31.535975 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 01 20:33:31.535975 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:33:31.535975 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 01 20:33:31.535975 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:33:31.535975 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:31.535975 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:31.535975 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:31.535975 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:31.535975 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:31.537301 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:31.537301 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:31.537301 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:31.537301 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:31.537301 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:31.537301 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:31.537301 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 01 20:33:31.537301 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 01 20:33:31.537301 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 01 20:33:31.537301 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 01 20:33:31.537301 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:31.537301 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:31.537301 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:31.537301 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:31.537301 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:31.537301 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:31.538350 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:31.538350 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:31.538350 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:31.538350 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:31.538350 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:31.538350 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:31.538350 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:31.538350 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:31.538350 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:31.538350 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:31.538350 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 01 20:33:31.538350 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 01 20:33:31.538350 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 01 20:33:31.538350 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:33:31.544651 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 333/666] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Oct 1 20:33:31 2022] GET /identity/v3/services/network => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:31.546809 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab30b89e-923f-4e5f-93d9-f3a7840be585 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:31.666683 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab30b89e-923f-4e5f-93d9-f3a7840be585 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:31.708492 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a15134-f116-4172-aff7-6023a6cdb3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:31.709414 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a15134-f116-4172-aff7-6023a6cdb3d2 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:31.709919 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a15134-f116-4172-aff7-6023a6cdb3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:31.710341 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a15134-f116-4172-aff7-6023a6cdb3d2 None admin] PATH_INFO: `/v3/services` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:31.711164 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a15134-f116-4172-aff7-6023a6cdb3d2 None admin] RBAC: Adding query filter params (name=network) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:31.711614 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a15134-f116-4172-aff7-6023a6cdb3d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:31.713149 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a15134-f116-4172-aff7-6023a6cdb3d2 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:31.718639 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 334/667] 10.222.0.23 () {56 vars in 1112 bytes} [Sat Oct 1 20:33:31 2022] GET /identity/v3/services?name=network => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:31.726599 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc1873a-28dc-4b47-84cb-1bb7a7166a09 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:31.829035 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc1873a-28dc-4b47-84cb-1bb7a7166a09 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:31.865582 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faadfa30-b19b-4044-b85b-da5288c3ddb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:31.866197 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faadfa30-b19b-4044-b85b-da5288c3ddb6 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:31.866475 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faadfa30-b19b-4044-b85b-da5288c3ddb6 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:31.866749 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faadfa30-b19b-4044-b85b-da5288c3ddb6 None admin] PATH_INFO: `/v3/services` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:31.867381 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faadfa30-b19b-4044-b85b-da5288c3ddb6 None admin] RBAC: Adding query filter params (type=network) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:31.867681 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faadfa30-b19b-4044-b85b-da5288c3ddb6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:31.869120 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faadfa30-b19b-4044-b85b-da5288c3ddb6 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:31.875049 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 334/668] 10.222.0.23 () {56 vars in 1112 bytes} [Sat Oct 1 20:33:31 2022] GET /identity/v3/services?type=network => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:33.250622 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e24d913-0420-4983-8e97-108d5a4ffaab None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:33.251626 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e24d913-0420-4983-8e97-108d5a4ffaab None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:33.252129 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e24d913-0420-4983-8e97-108d5a4ffaab None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:33.254063 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 335/669] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:33:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:33:33.260299 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37892ac1-37ba-4e4b-9a57-daee482506b7 None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:33.260883 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37892ac1-37ba-4e4b-9a57-daee482506b7 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:33.261322 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37892ac1-37ba-4e4b-9a57-daee482506b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:33.282812 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-37892ac1-37ba-4e4b-9a57-daee482506b7 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:33:33.284011 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-37892ac1-37ba-4e4b-9a57-daee482506b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:33:33.346879 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:33.355212 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 335/670] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:33:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 20:33:33.686417 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e24d913-0420-4983-8e97-108d5a4ffaab None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:33.750307 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:33.801777 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e24d913-0420-4983-8e97-108d5a4ffaab None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:33.837893 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33017d0f-8c13-4cb7-91f2-079072973c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:33.838569 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33017d0f-8c13-4cb7-91f2-079072973c6e None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:33.838845 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33017d0f-8c13-4cb7-91f2-079072973c6e None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:33.839109 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33017d0f-8c13-4cb7-91f2-079072973c6e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:33.850612 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33017d0f-8c13-4cb7-91f2-079072973c6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 20:33:33.855519 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-33017d0f-8c13-4cb7-91f2-079072973c6e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 20:33:33.855519 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:33.855519 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:33.855519 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:33.855519 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:33.855519 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:33.855519 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:33.855519 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:33.855519 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:33.855519 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:33.855519 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:33.855519 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:33.855519 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 20:33:33.855519 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 20:33:33.855519 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 20:33:33.855519 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 20:33:33.857234 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 20:33:33.857234 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 20:33:33.857234 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 20:33:33.857234 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 20:33:33.857234 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:33.857234 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:33.857234 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:33.857234 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:33.857234 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:33.857234 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:33.857234 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:33.857234 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:33.857234 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:33.857234 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:33.857234 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:33.857234 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:33.858634 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:33.858634 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:33.858634 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:33.858634 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:33.858634 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 20:33:33.858634 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 20:33:33.858634 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 20:33:33.858634 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 20:33:33.858634 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 20:33:33.858634 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 20:33:33.858634 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 20:33:33.858634 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:33:33.858634 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 336/671] 10.222.0.23 () {56 vars in 1096 bytes} [Sat Oct 1 20:33:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:33.863563 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37892ac1-37ba-4e4b-9a57-daee482506b7 None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:33.909550 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd3079-3e99-4497-bcbe-b4360519da67 None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:33.909873 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd3079-3e99-4497-bcbe-b4360519da67 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:33.910090 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd3079-3e99-4497-bcbe-b4360519da67 None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:33.911946 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 337/672] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:33:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:33:33.917558 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b55c2b-d428-48d2-b287-d4b26feda679 None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:33.917833 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b55c2b-d428-48d2-b287-d4b26feda679 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:33.918100 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b55c2b-d428-48d2-b287-d4b26feda679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:33.937650 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-91b55c2b-d428-48d2-b287-d4b26feda679 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:33:33.938769 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-91b55c2b-d428-48d2-b287-d4b26feda679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:33:33.976592 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37892ac1-37ba-4e4b-9a57-daee482506b7 None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:34.012874 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09af2194-e788-46e2-a491-d4a1cedc8454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:34.013499 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af2194-e788-46e2-a491-d4a1cedc8454 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:34.013760 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af2194-e788-46e2-a491-d4a1cedc8454 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:34.014031 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af2194-e788-46e2-a491-d4a1cedc8454 None admin] PATH_INFO: `/v3/roles` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:34.014687 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09af2194-e788-46e2-a491-d4a1cedc8454 None admin] RBAC: Adding query filter params (name=admin) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:34.014989 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09af2194-e788-46e2-a491-d4a1cedc8454 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:34.015854 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 338/673] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:33:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 01 20:33:34.016365 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09af2194-e788-46e2-a491-d4a1cedc8454 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:34.024969 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 336/674] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Oct 1 20:33:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:34.025882 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e9d6f-3298-43d4-b0f7-d8446c653fc7 None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:34.026168 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e9d6f-3298-43d4-b0f7-d8446c653fc7 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:34.026442 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e9d6f-3298-43d4-b0f7-d8446c653fc7 None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:34.027837 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 339/675] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:33:34 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:33:34.033402 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09af2194-e788-46e2-a491-d4a1cedc8454 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:34.033608 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef19513-3611-4239-9511-6613f22bb346 None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:34.033892 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef19513-3611-4239-9511-6613f22bb346 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:34.034164 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef19513-3611-4239-9511-6613f22bb346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:34.059018 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-9ef19513-3611-4239-9511-6613f22bb346 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:33:34.060980 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-9ef19513-3611-4239-9511-6613f22bb346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:33:34.097721 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:34.113721 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:34.145725 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 340/676] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:33:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 20:33:34.163599 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09af2194-e788-46e2-a491-d4a1cedc8454 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:34.200799 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca70052-d97a-4d35-ab1c-e46a886e968c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:34.201481 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca70052-d97a-4d35-ab1c-e46a886e968c None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:34.201816 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca70052-d97a-4d35-ab1c-e46a886e968c None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:34.202277 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca70052-d97a-4d35-ab1c-e46a886e968c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:34.213707 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca70052-d97a-4d35-ab1c-e46a886e968c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:34.215203 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca70052-d97a-4d35-ab1c-e46a886e968c None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:34.230747 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application [None req-5ca70052-d97a-4d35-ab1c-e46a886e968c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:33:34.230747 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:34.230747 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:34.230747 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:34.230747 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:34.230747 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:34.230747 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:34.230747 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:34.230747 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:34.230747 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:34.230747 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:34.230747 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:34.230747 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 20:33:34.230747 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 20:33:34.230747 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 20:33:34.230747 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 20:33:34.231839 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:34.231839 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:34.231839 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:34.231839 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:34.231839 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:34.231839 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:34.231839 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:34.231839 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:34.231839 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:34.231839 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:34.231839 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:34.231839 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:34.231839 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:34.231839 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:34.231839 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:34.231839 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:34.231839 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 20:33:34.232769 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 20:33:34.232769 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:33:34.232769 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:33:34.232769 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 337/677] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Oct 1 20:33:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:34.238033 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef19513-3611-4239-9511-6613f22bb346 None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:34.311079 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef76a44-8c37-40a3-b787-e2e92eb33fd1 None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:34.311755 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef76a44-8c37-40a3-b787-e2e92eb33fd1 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:34.311755 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef76a44-8c37-40a3-b787-e2e92eb33fd1 None None] PATH_INFO: `/` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:34.313451 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 338/678] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:33:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:33:34.321578 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a0c7a-5822-4884-abb6-b6d345a34644 None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:34.322141 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a0c7a-5822-4884-abb6-b6d345a34644 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:34.322678 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a0c7a-5822-4884-abb6-b6d345a34644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:34.347180 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-880a0c7a-5822-4884-abb6-b6d345a34644 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:33:34.348811 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-880a0c7a-5822-4884-abb6-b6d345a34644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:33:34.349479 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef19513-3611-4239-9511-6613f22bb346 None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:34.398985 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368bc5de-ee0a-4dea-ae09-7b9631441351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:34.399697 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368bc5de-ee0a-4dea-ae09-7b9631441351 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:34.400360 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368bc5de-ee0a-4dea-ae09-7b9631441351 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:34.400675 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368bc5de-ee0a-4dea-ae09-7b9631441351 None admin] PATH_INFO: `/v3/domains` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:34.401322 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368bc5de-ee0a-4dea-ae09-7b9631441351 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:34.401780 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368bc5de-ee0a-4dea-ae09-7b9631441351 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:34.403849 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368bc5de-ee0a-4dea-ae09-7b9631441351 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:34.415500 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 341/679] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Oct 1 20:33:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:34.416555 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368bc5de-ee0a-4dea-ae09-7b9631441351 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:34.426173 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 339/680] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:33:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 20:33:34.427263 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880a0c7a-5822-4884-abb6-b6d345a34644 None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:34.462173 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:34.476892 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:34.526819 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368bc5de-ee0a-4dea-ae09-7b9631441351 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:34.537683 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880a0c7a-5822-4884-abb6-b6d345a34644 None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:34.562782 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f8e6f5-f86d-43c5-b022-8031dbfda146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:34.563436 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8e6f5-f86d-43c5-b022-8031dbfda146 None admin] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:34.563720 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8e6f5-f86d-43c5-b022-8031dbfda146 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:34.563988 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8e6f5-f86d-43c5-b022-8031dbfda146 None admin] PATH_INFO: `/v3/services` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:34.564669 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f8e6f5-f86d-43c5-b022-8031dbfda146 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:34.566035 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f8e6f5-f86d-43c5-b022-8031dbfda146 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:34.579165 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28c6256-d1cb-4eaa-857d-984463a01e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:34.579789 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28c6256-d1cb-4eaa-857d-984463a01e23 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:34.580057 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28c6256-d1cb-4eaa-857d-984463a01e23 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:34.580474 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28c6256-d1cb-4eaa-857d-984463a01e23 None admin] PATH_INFO: `/v3/users/nova` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:34.585136 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 342/681] 10.222.0.23 () {60 vars in 1141 bytes} [Sat Oct 1 20:33:34 2022] POST /identity/v3/services => generated 251 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 20:33:34.586116 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f8e6f5-f86d-43c5-b022-8031dbfda146 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:34.588703 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28c6256-d1cb-4eaa-857d-984463a01e23 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:34.590481 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28c6256-d1cb-4eaa-857d-984463a01e23 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:34.603801 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application [None req-d28c6256-d1cb-4eaa-857d-984463a01e23 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 01 20:33:34.603801 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:34.603801 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:34.603801 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:34.603801 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:34.603801 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:34.603801 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:34.603801 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:34.603801 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:34.603801 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:34.603801 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:34.603801 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:34.603801 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 01 20:33:34.603801 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 01 20:33:34.603801 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 01 20:33:34.603801 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 01 20:33:34.604879 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:34.604879 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:34.604879 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 01 20:33:34.604879 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 20:33:34.604879 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 01 20:33:34.604879 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 20:33:34.604879 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:34.604879 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:34.604879 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:34.604879 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:34.604879 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:34.604879 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:34.604879 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:34.604879 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:34.604879 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:34.604879 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:34.604879 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:34.604879 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:34.605831 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:34.605831 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:34.605831 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 01 20:33:34.605831 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 01 20:33:34.605831 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 01 20:33:34.605831 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 01 20:33:34.605831 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 01 20:33:34.605831 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 01 20:33:34.605831 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 01 20:33:34.605831 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:33:34.614105 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 340/682] 10.222.0.23 () {56 vars in 1093 bytes} [Sat Oct 1 20:33:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:34.615664 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28c6256-d1cb-4eaa-857d-984463a01e23 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:34.721209 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:34.736142 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f8e6f5-f86d-43c5-b022-8031dbfda146 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:34.746061 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:34.755281 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28c6256-d1cb-4eaa-857d-984463a01e23 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:34.781547 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502bf4bf-f104-443d-a6d3-a7cbdded983c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:34.782237 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502bf4bf-f104-443d-a6d3-a7cbdded983c None admin] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:34.782650 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502bf4bf-f104-443d-a6d3-a7cbdded983c None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:34.782928 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502bf4bf-f104-443d-a6d3-a7cbdded983c None admin] PATH_INFO: `/v3/services` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:34.783802 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502bf4bf-f104-443d-a6d3-a7cbdded983c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:34.785649 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502bf4bf-f104-443d-a6d3-a7cbdded983c None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:34.796997 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1195fa73-4135-46a8-a413-bdb7cfd5a6ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:34.797610 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1195fa73-4135-46a8-a413-bdb7cfd5a6ea None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:34.797926 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1195fa73-4135-46a8-a413-bdb7cfd5a6ea None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:34.798212 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1195fa73-4135-46a8-a413-bdb7cfd5a6ea None admin] PATH_INFO: `/v3/users` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:34.798864 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1195fa73-4135-46a8-a413-bdb7cfd5a6ea None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:34.799222 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1195fa73-4135-46a8-a413-bdb7cfd5a6ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:34.800727 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1195fa73-4135-46a8-a413-bdb7cfd5a6ea None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:34.801828 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 343/683] 10.222.0.23 () {60 vars in 1141 bytes} [Sat Oct 1 20:33:34 2022] POST /identity/v3/services => generated 242 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 20:33:34.802452 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502bf4bf-f104-443d-a6d3-a7cbdded983c None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:34.834311 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 341/684] 10.222.0.23 () {56 vars in 1133 bytes} [Sat Oct 1 20:33:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:34.840462 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1195fa73-4135-46a8-a413-bdb7cfd5a6ea None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:34.963980 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502bf4bf-f104-443d-a6d3-a7cbdded983c None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:34.984859 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1195fa73-4135-46a8-a413-bdb7cfd5a6ea None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:35.017356 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252175e8-8fcd-4a3d-9dbe-5afa6ee00cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:35.018628 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252175e8-8fcd-4a3d-9dbe-5afa6ee00cc7 None admin] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:35.019094 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252175e8-8fcd-4a3d-9dbe-5afa6ee00cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:35.019705 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252175e8-8fcd-4a3d-9dbe-5afa6ee00cc7 None admin] PATH_INFO: `/v3/services` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:35.020961 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252175e8-8fcd-4a3d-9dbe-5afa6ee00cc7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:35.023008 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252175e8-8fcd-4a3d-9dbe-5afa6ee00cc7 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:35.033795 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3027f600-0b23-45ff-b74a-b8ce14693438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:35.035124 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3027f600-0b23-45ff-b74a-b8ce14693438 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:35.035124 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3027f600-0b23-45ff-b74a-b8ce14693438 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:35.035331 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3027f600-0b23-45ff-b74a-b8ce14693438 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:35.046708 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 344/685] 10.222.0.23 () {60 vars in 1141 bytes} [Sat Oct 1 20:33:34 2022] POST /identity/v3/services => generated 240 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 20:33:35.057382 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3027f600-0b23-45ff-b74a-b8ce14693438 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:35.058881 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3027f600-0b23-45ff-b74a-b8ce14693438 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:35.080363 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application [None req-3027f600-0b23-45ff-b74a-b8ce14693438 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:33:35.080363 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:35.080363 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:35.080363 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:35.080363 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:35.080363 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:35.080363 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:35.080363 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:35.080363 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:35.080363 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:35.080363 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:35.080363 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:35.080363 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 20:33:35.080363 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 20:33:35.080363 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 20:33:35.080363 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 20:33:35.081492 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:35.081492 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:35.081492 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:35.081492 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:35.081492 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:35.081492 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:35.081492 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:35.081492 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:35.081492 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:35.081492 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:35.081492 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:35.081492 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:35.081492 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:35.081492 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:35.081492 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:35.081492 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:35.081492 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 20:33:35.082407 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 20:33:35.082407 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:33:35.082407 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:33:35.082407 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 342/686] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Oct 1 20:33:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:35.087434 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252175e8-8fcd-4a3d-9dbe-5afa6ee00cc7 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:35.105190 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:35.230088 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252175e8-8fcd-4a3d-9dbe-5afa6ee00cc7 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:35.269378 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b791ef6-ca61-4017-a728-f6de8862170f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:35.269915 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b791ef6-ca61-4017-a728-f6de8862170f None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:35.270194 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b791ef6-ca61-4017-a728-f6de8862170f None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:35.270470 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b791ef6-ca61-4017-a728-f6de8862170f None admin] PATH_INFO: `/v3/domains` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:35.271122 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b791ef6-ca61-4017-a728-f6de8862170f None admin] RBAC: Adding query filter params (name=Default) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:35.271428 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b791ef6-ca61-4017-a728-f6de8862170f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:35.272830 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b791ef6-ca61-4017-a728-f6de8862170f None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:35.285743 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 345/687] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Oct 1 20:33:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:35.290908 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3027f600-0b23-45ff-b74a-b8ce14693438 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:35.304364 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:35.413517 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3027f600-0b23-45ff-b74a-b8ce14693438 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:35.449509 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec183f28-0bc2-4d63-ad00-9315261ef10e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:35.450181 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec183f28-0bc2-4d63-ad00-9315261ef10e None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:35.450453 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec183f28-0bc2-4d63-ad00-9315261ef10e None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:35.450719 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec183f28-0bc2-4d63-ad00-9315261ef10e None admin] PATH_INFO: `/v3/projects/service` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:35.460379 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec183f28-0bc2-4d63-ad00-9315261ef10e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:35.461946 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec183f28-0bc2-4d63-ad00-9315261ef10e None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:35.474361 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application [None req-ec183f28-0bc2-4d63-ad00-9315261ef10e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 20:33:35.474361 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:35.474361 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:35.474361 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:35.474361 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:35.474361 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:35.474361 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:35.474361 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:35.474361 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:35.474361 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:35.474361 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:35.474361 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:35.474361 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 01 20:33:35.474361 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 01 20:33:35.474361 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 01 20:33:35.475325 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 01 20:33:35.475325 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:35.475325 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:35.475325 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:35.475325 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:35.475325 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:35.475325 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:35.475325 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:35.475325 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:35.475325 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:35.475325 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:35.475325 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:35.475325 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:35.475325 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:35.475325 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:35.475325 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:35.475325 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:35.476258 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 01 20:33:35.476258 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 01 20:33:35.476258 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 01 20:33:35.476258 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 01 20:33:35.476258 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 01 20:33:35.476258 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 01 20:33:35.476258 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 20:33:35.476258 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:33:35.476258 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 343/688] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Oct 1 20:33:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 01 20:33:35.482007 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b791ef6-ca61-4017-a728-f6de8862170f None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:35.550668 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:35.589450 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b791ef6-ca61-4017-a728-f6de8862170f None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:35.625368 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec904d02-e7d7-45ca-bcf3-0667c910a206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:35.626252 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec904d02-e7d7-45ca-bcf3-0667c910a206 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:35.626678 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec904d02-e7d7-45ca-bcf3-0667c910a206 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:35.627108 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec904d02-e7d7-45ca-bcf3-0667c910a206 None admin] PATH_INFO: `/v3/projects` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:35.627944 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec904d02-e7d7-45ca-bcf3-0667c910a206 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:35.628401 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec904d02-e7d7-45ca-bcf3-0667c910a206 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:35.630006 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec904d02-e7d7-45ca-bcf3-0667c910a206 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:35.644009 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 346/689] 10.222.0.23 () {56 vars in 1148 bytes} [Sat Oct 1 20:33:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 20:33:35.649830 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec183f28-0bc2-4d63-ad00-9315261ef10e None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:35.722825 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:35.757648 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec183f28-0bc2-4d63-ad00-9315261ef10e None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:35.793270 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376ec3aa-a04e-4d3b-8bd9-106eb5407504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:35.794061 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376ec3aa-a04e-4d3b-8bd9-106eb5407504 None admin] REQUEST_METHOD: `PUT` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:35.794336 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376ec3aa-a04e-4d3b-8bd9-106eb5407504 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:35.794612 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376ec3aa-a04e-4d3b-8bd9-106eb5407504 None admin] PATH_INFO: `/v3/projects/8f242c4eeaa04ed19dcdc8ba95b86cfb/users/b9c31d26f19d46f09e2f2e5e660234f2/roles/d11e7ba2f1fa41ff8ea8dda2a8d1466f` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:35.796473 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376ec3aa-a04e-4d3b-8bd9-106eb5407504 None admin] RBAC: Authorizing `identity:create_grant(project_id=8f242c4eeaa04ed19dcdc8ba95b86cfb, user_id=b9c31d26f19d46f09e2f2e5e660234f2, role_id=d11e7ba2f1fa41ff8ea8dda2a8d1466f)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:35.797942 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376ec3aa-a04e-4d3b-8bd9-106eb5407504 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:35.814014 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 344/690] 10.222.0.23 () {58 vars in 1439 bytes} [Sat Oct 1 20:33:35 2022] PUT /identity/v3/projects/8f242c4eeaa04ed19dcdc8ba95b86cfb/users/b9c31d26f19d46f09e2f2e5e660234f2/roles/d11e7ba2f1fa41ff8ea8dda2a8d1466f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 20:33:37.228795 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ff27d8-0494-44ef-9310-653af04d5324 None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:37.229483 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ff27d8-0494-44ef-9310-653af04d5324 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:37.229483 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ff27d8-0494-44ef-9310-653af04d5324 None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:37.230957 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 347/691] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:33:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:33:37.236262 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe3075-dc14-4b73-9f4e-30bbddb5b8af None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:37.236808 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe3075-dc14-4b73-9f4e-30bbddb5b8af None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:37.236808 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe3075-dc14-4b73-9f4e-30bbddb5b8af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:37.255862 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-e6fe3075-dc14-4b73-9f4e-30bbddb5b8af None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:33:37.257069 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-e6fe3075-dc14-4b73-9f4e-30bbddb5b8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:33:37.328103 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 345/692] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:33:37 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 01 20:33:37.480516 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f58121f-9c84-43ad-8de9-4acbdfa618de None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:37.480964 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f58121f-9c84-43ad-8de9-4acbdfa618de None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:37.481284 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f58121f-9c84-43ad-8de9-4acbdfa618de None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:37.483261 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 348/693] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:33:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:33:37.488416 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024975a6-8d1b-4144-bc2f-3fabfca64b67 None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:37.488757 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024975a6-8d1b-4144-bc2f-3fabfca64b67 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:37.489024 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024975a6-8d1b-4144-bc2f-3fabfca64b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:37.511378 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-024975a6-8d1b-4144-bc2f-3fabfca64b67 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:33:37.513778 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-024975a6-8d1b-4144-bc2f-3fabfca64b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:33:37.567842 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:37.585733 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 346/694] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:33:37 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 01 20:33:37.602578 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3beec-2a9d-4100-ab6b-38a4ece1f406 None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:37.602848 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3beec-2a9d-4100-ab6b-38a4ece1f406 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:37.603116 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3beec-2a9d-4100-ab6b-38a4ece1f406 None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:37.604752 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 349/695] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:33:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:33:37.610583 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5fc87e-2f7b-499d-b838-11e2e4e53ecf None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:37.611105 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5fc87e-2f7b-499d-b838-11e2e4e53ecf None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:37.611587 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5fc87e-2f7b-499d-b838-11e2e4e53ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:37.630691 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-3a5fc87e-2f7b-499d-b838-11e2e4e53ecf None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:33:37.632184 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-3a5fc87e-2f7b-499d-b838-11e2e4e53ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:33:37.695140 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b3beec-2a9d-4100-ab6b-38a4ece1f406 None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:37.707583 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 347/696] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:33:37 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 01 20:33:37.815073 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b3beec-2a9d-4100-ab6b-38a4ece1f406 None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:37.849080 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:37.861352 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3288d9a8-4523-4cd6-9597-a375f3eced27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:37.862094 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288d9a8-4523-4cd6-9597-a375f3eced27 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:37.862374 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288d9a8-4523-4cd6-9597-a375f3eced27 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:37.862646 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288d9a8-4523-4cd6-9597-a375f3eced27 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:37.863283 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3288d9a8-4523-4cd6-9597-a375f3eced27 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:37.864892 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3288d9a8-4523-4cd6-9597-a375f3eced27 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:37.876393 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-3288d9a8-4523-4cd6-9597-a375f3eced27 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 01 20:33:37.876393 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:37.876393 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 01 20:33:37.876393 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 01 20:33:37.876393 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 01 20:33:37.876393 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 01 20:33:37.876393 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 01 20:33:37.876393 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 01 20:33:37.876393 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 01 20:33:37.876393 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:33:37.876393 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 01 20:33:37.876393 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:33:37.876393 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:37.876393 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:37.876393 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:37.876393 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:37.876393 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:37.877649 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:37.877649 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:37.877649 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:37.877649 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:37.877649 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:37.877649 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:37.877649 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 01 20:33:37.877649 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 01 20:33:37.877649 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 01 20:33:37.877649 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 01 20:33:37.877649 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:37.877649 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:37.877649 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:37.877649 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:37.877649 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:37.877649 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:37.878588 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:37.878588 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:37.878588 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:37.878588 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:37.878588 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:37.878588 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:37.878588 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:37.878588 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:37.878588 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:37.878588 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:37.878588 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 01 20:33:37.878588 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 01 20:33:37.878588 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 01 20:33:37.878588 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:33:37.878588 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 350/697] 10.222.0.23 () {56 vars in 1129 bytes} [Sat Oct 1 20:33:37 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:37.884151 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5fc87e-2f7b-499d-b838-11e2e4e53ecf None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:37.938073 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3288d9a8-4523-4cd6-9597-a375f3eced27 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:37.991421 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5fc87e-2f7b-499d-b838-11e2e4e53ecf None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:38.010246 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:38.030023 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c997d0b-cb0d-4afb-a089-0ec14daab8c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:38.030628 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c997d0b-cb0d-4afb-a089-0ec14daab8c3 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:38.030900 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c997d0b-cb0d-4afb-a089-0ec14daab8c3 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:38.031215 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c997d0b-cb0d-4afb-a089-0ec14daab8c3 None admin] PATH_INFO: `/v3/services` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:38.031841 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c997d0b-cb0d-4afb-a089-0ec14daab8c3 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:38.032141 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c997d0b-cb0d-4afb-a089-0ec14daab8c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:38.033561 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c997d0b-cb0d-4afb-a089-0ec14daab8c3 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:38.038517 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 348/698] 10.222.0.23 () {56 vars in 1124 bytes} [Sat Oct 1 20:33:37 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:38.043964 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c997d0b-cb0d-4afb-a089-0ec14daab8c3 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:38.044951 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3288d9a8-4523-4cd6-9597-a375f3eced27 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:38.084391 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d464a8-d0ab-4ef4-9f13-312683c0e2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:38.085001 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d464a8-d0ab-4ef4-9f13-312683c0e2e8 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:38.085274 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d464a8-d0ab-4ef4-9f13-312683c0e2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:38.085545 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d464a8-d0ab-4ef4-9f13-312683c0e2e8 None admin] PATH_INFO: `/v3/services/image` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:38.086172 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d464a8-d0ab-4ef4-9f13-312683c0e2e8 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:38.087544 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d464a8-d0ab-4ef4-9f13-312683c0e2e8 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:38.097175 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-83d464a8-d0ab-4ef4-9f13-312683c0e2e8 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 01 20:33:38.097175 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:38.097175 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 01 20:33:38.097175 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 01 20:33:38.097175 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 01 20:33:38.097175 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 01 20:33:38.097175 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 01 20:33:38.097175 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 01 20:33:38.097175 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 01 20:33:38.097175 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:33:38.097175 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 01 20:33:38.097175 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:33:38.097175 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:38.097175 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:38.097175 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:38.097175 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:38.097175 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:38.098180 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:38.098180 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:38.098180 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:38.098180 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:38.098180 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:38.098180 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:38.098180 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 01 20:33:38.098180 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 01 20:33:38.098180 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 01 20:33:38.098180 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 01 20:33:38.098180 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:38.098180 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:38.098180 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:38.098180 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:38.098180 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:38.098180 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:38.099043 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:38.099043 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:38.099043 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:38.099043 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:38.099043 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:38.099043 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:38.099043 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:38.099043 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:38.099043 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:38.099043 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:38.099043 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 01 20:33:38.099043 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 01 20:33:38.099043 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 01 20:33:38.099043 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:33:38.103184 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 351/699] 10.222.0.23 () {56 vars in 1105 bytes} [Sat Oct 1 20:33:37 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:38.104008 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d464a8-d0ab-4ef4-9f13-312683c0e2e8 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:38.148051 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c997d0b-cb0d-4afb-a089-0ec14daab8c3 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:38.163882 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:38.193976 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff54ca7-a761-4726-94d4-763094ef0522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:38.194579 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff54ca7-a761-4726-94d4-763094ef0522 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:38.194863 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff54ca7-a761-4726-94d4-763094ef0522 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:38.195142 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff54ca7-a761-4726-94d4-763094ef0522 None admin] PATH_INFO: `/v3/services` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:38.195764 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff54ca7-a761-4726-94d4-763094ef0522 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:38.196069 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff54ca7-a761-4726-94d4-763094ef0522 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:38.197495 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff54ca7-a761-4726-94d4-763094ef0522 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:38.202972 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 349/700] 10.222.0.23 () {56 vars in 1124 bytes} [Sat Oct 1 20:33:38 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 20:33:38.203663 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff54ca7-a761-4726-94d4-763094ef0522 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:38.216890 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d464a8-d0ab-4ef4-9f13-312683c0e2e8 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:38.252921 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:38.257047 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8cd77f-93bb-4085-819f-433599dba566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:38.258202 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8cd77f-93bb-4085-819f-433599dba566 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:38.258484 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8cd77f-93bb-4085-819f-433599dba566 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:38.258762 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8cd77f-93bb-4085-819f-433599dba566 None admin] PATH_INFO: `/v3/services/network` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:38.259343 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8cd77f-93bb-4085-819f-433599dba566 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:38.261206 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8cd77f-93bb-4085-819f-433599dba566 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:38.270893 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-ce8cd77f-93bb-4085-819f-433599dba566 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 01 20:33:38.270893 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:38.270893 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 01 20:33:38.270893 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 01 20:33:38.270893 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 01 20:33:38.270893 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 01 20:33:38.270893 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 01 20:33:38.270893 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 01 20:33:38.270893 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 01 20:33:38.270893 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:33:38.270893 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 01 20:33:38.270893 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:33:38.270893 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:38.270893 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:38.270893 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:38.270893 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:38.270893 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:38.272087 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:38.272087 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:38.272087 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:38.272087 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:38.272087 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:38.272087 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:38.272087 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 01 20:33:38.272087 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 01 20:33:38.272087 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 01 20:33:38.272087 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 01 20:33:38.272087 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:38.272087 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:38.272087 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:38.272087 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:38.272087 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:38.272087 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:38.273183 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:38.273183 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:38.273183 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:38.273183 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:38.273183 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:38.273183 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:38.273183 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:38.273183 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:38.273183 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:38.273183 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:38.273183 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 01 20:33:38.273183 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 01 20:33:38.273183 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 01 20:33:38.273183 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:33:38.276926 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 352/701] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Oct 1 20:33:38 2022] GET /identity/v3/services/network => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:38.278442 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8cd77f-93bb-4085-819f-433599dba566 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:38.314448 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff54ca7-a761-4726-94d4-763094ef0522 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:38.348932 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd75f2f-8ecf-4140-a6ca-f88b4df6329d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:38.349460 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd75f2f-8ecf-4140-a6ca-f88b4df6329d None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:38.349740 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd75f2f-8ecf-4140-a6ca-f88b4df6329d None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:38.350011 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd75f2f-8ecf-4140-a6ca-f88b4df6329d None admin] PATH_INFO: `/v3/services` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:38.350630 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd75f2f-8ecf-4140-a6ca-f88b4df6329d None admin] RBAC: Adding query filter params (name=image) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:38.350937 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd75f2f-8ecf-4140-a6ca-f88b4df6329d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:38.352301 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd75f2f-8ecf-4140-a6ca-f88b4df6329d None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:38.357452 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 350/702] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Oct 1 20:33:38 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:38.358227 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd75f2f-8ecf-4140-a6ca-f88b4df6329d None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:38.377403 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8cd77f-93bb-4085-819f-433599dba566 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:38.394718 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:38.412483 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ed1185-fa69-46d5-af3b-fe1707b6ec52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:38.413116 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed1185-fa69-46d5-af3b-fe1707b6ec52 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:38.413397 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed1185-fa69-46d5-af3b-fe1707b6ec52 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:38.413667 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed1185-fa69-46d5-af3b-fe1707b6ec52 None admin] PATH_INFO: `/v3/endpoints` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:38.414364 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ed1185-fa69-46d5-af3b-fe1707b6ec52 None admin] RBAC: Adding query filter params (interface=public, service_id=f704b3e04f6345269e77dd36bf1ddfb3, region_id=RegionOne) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:38.414673 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ed1185-fa69-46d5-af3b-fe1707b6ec52 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:38.416038 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ed1185-fa69-46d5-af3b-fe1707b6ec52 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:38.430663 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 353/703] 10.222.0.23 () {56 vars in 1251 bytes} [Sat Oct 1 20:33:38 2022] GET /identity/v3/endpoints?service_id=f704b3e04f6345269e77dd36bf1ddfb3&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:38.430663 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef6e577-8d40-4015-8b69-cf09649f2af5 None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:38.430663 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef6e577-8d40-4015-8b69-cf09649f2af5 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:38.430663 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef6e577-8d40-4015-8b69-cf09649f2af5 None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:38.430663 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 354/704] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:33:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:33:38.430663 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef6e577-8d40-4015-8b69-cf09649f2af5 None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:38.464992 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd75f2f-8ecf-4140-a6ca-f88b4df6329d None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:38.477039 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:38.500719 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b2c202-7226-45a1-b0e9-cc8bf33f179e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:38.501323 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b2c202-7226-45a1-b0e9-cc8bf33f179e None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:38.501599 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b2c202-7226-45a1-b0e9-cc8bf33f179e None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:38.501874 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b2c202-7226-45a1-b0e9-cc8bf33f179e None admin] PATH_INFO: `/v3/services` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:38.502492 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b2c202-7226-45a1-b0e9-cc8bf33f179e None admin] RBAC: Adding query filter params (name=network) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:38.502794 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b2c202-7226-45a1-b0e9-cc8bf33f179e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:38.504173 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b2c202-7226-45a1-b0e9-cc8bf33f179e None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:38.508684 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 351/705] 10.222.0.23 () {56 vars in 1112 bytes} [Sat Oct 1 20:33:38 2022] GET /identity/v3/services?name=network => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:38.509508 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b2c202-7226-45a1-b0e9-cc8bf33f179e None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:38.539525 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef6e577-8d40-4015-8b69-cf09649f2af5 None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:38.576316 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f62b0a0-3f08-4ddd-8a30-758f876844fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:38.576960 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f62b0a0-3f08-4ddd-8a30-758f876844fb None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:38.577234 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f62b0a0-3f08-4ddd-8a30-758f876844fb None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:38.577496 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f62b0a0-3f08-4ddd-8a30-758f876844fb None admin] PATH_INFO: `/v3/services` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:38.578134 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f62b0a0-3f08-4ddd-8a30-758f876844fb None admin] RBAC: Adding query filter params (type=image) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:38.578427 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f62b0a0-3f08-4ddd-8a30-758f876844fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:38.579819 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f62b0a0-3f08-4ddd-8a30-758f876844fb None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:38.585312 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 355/706] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Oct 1 20:33:38 2022] GET /identity/v3/services?type=image => generated 350 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:38.586634 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b91b453-bedd-42b5-8207-10e7c214f069 None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:38.586919 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b91b453-bedd-42b5-8207-10e7c214f069 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:38.587188 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b91b453-bedd-42b5-8207-10e7c214f069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:38.606506 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-8b91b453-bedd-42b5-8207-10e7c214f069 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:33:38.607637 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-8b91b453-bedd-42b5-8207-10e7c214f069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:33:38.652723 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:38.677621 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 356/707] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:33:38 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 01 20:33:38.678461 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b91b453-bedd-42b5-8207-10e7c214f069 None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:38.747872 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b2c202-7226-45a1-b0e9-cc8bf33f179e None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:38.783640 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab3c86e-2f27-470e-8674-09b4de1f4aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:38.784244 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab3c86e-2f27-470e-8674-09b4de1f4aa9 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:38.784538 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab3c86e-2f27-470e-8674-09b4de1f4aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:38.784818 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab3c86e-2f27-470e-8674-09b4de1f4aa9 None admin] PATH_INFO: `/v3/services` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:38.785410 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab3c86e-2f27-470e-8674-09b4de1f4aa9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:38.786805 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab3c86e-2f27-470e-8674-09b4de1f4aa9 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:38.792217 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 352/708] 10.222.0.23 () {56 vars in 1087 bytes} [Sat Oct 1 20:33:38 2022] GET /identity/v3/services => generated 1002 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 20:33:38.793028 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab3c86e-2f27-470e-8674-09b4de1f4aa9 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:38.822454 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b91b453-bedd-42b5-8207-10e7c214f069 None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:38.862473 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:38.862658 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3630e9-e155-43db-8792-e217c62761ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:38.863820 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3630e9-e155-43db-8792-e217c62761ba None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:38.864009 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3630e9-e155-43db-8792-e217c62761ba None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:38.864287 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3630e9-e155-43db-8792-e217c62761ba None admin] PATH_INFO: `/v3/services` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:38.865004 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3630e9-e155-43db-8792-e217c62761ba None admin] RBAC: Adding query filter params (type=network) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:38.865309 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3630e9-e155-43db-8792-e217c62761ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:38.867080 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3630e9-e155-43db-8792-e217c62761ba None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:38.878923 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 357/709] 10.222.0.23 () {56 vars in 1112 bytes} [Sat Oct 1 20:33:38 2022] GET /identity/v3/services?type=network => generated 350 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:38.880127 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3630e9-e155-43db-8792-e217c62761ba None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:38.932933 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:38.945732 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab3c86e-2f27-470e-8674-09b4de1f4aa9 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:38.983908 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae1c927-32a3-49ea-ad18-570011282f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:38.984657 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae1c927-32a3-49ea-ad18-570011282f8f None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:38.984837 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae1c927-32a3-49ea-ad18-570011282f8f None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:38.985103 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae1c927-32a3-49ea-ad18-570011282f8f None admin] PATH_INFO: `/v3/endpoints` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:38.985816 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae1c927-32a3-49ea-ad18-570011282f8f None admin] RBAC: Adding query filter params (interface=public, service_id=aebf11f0a8c44c3f92a386924e039749, region_id=RegionOne) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:38.986146 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae1c927-32a3-49ea-ad18-570011282f8f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:38.987522 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae1c927-32a3-49ea-ad18-570011282f8f None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:39.002356 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 353/710] 10.222.0.23 () {56 vars in 1251 bytes} [Sat Oct 1 20:33:38 2022] GET /identity/v3/endpoints?service_id=aebf11f0a8c44c3f92a386924e039749&interface=public®ion_id=RegionOne => generated 194 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:39.003405 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae1c927-32a3-49ea-ad18-570011282f8f None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:39.016079 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3630e9-e155-43db-8792-e217c62761ba None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:39.056388 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d04a3e4-43a5-40ac-83bc-4fe010edb3ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:39.057507 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d04a3e4-43a5-40ac-83bc-4fe010edb3ba None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:39.057799 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d04a3e4-43a5-40ac-83bc-4fe010edb3ba None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:39.058068 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d04a3e4-43a5-40ac-83bc-4fe010edb3ba None admin] PATH_INFO: `/v3/endpoints` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:39.059732 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d04a3e4-43a5-40ac-83bc-4fe010edb3ba None admin] RBAC: Adding query filter params (interface=public, service_id=2d4fcb7343204795b960456e85d3e224, region_id=RegionOne) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:39.059981 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d04a3e4-43a5-40ac-83bc-4fe010edb3ba None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:39.061388 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d04a3e4-43a5-40ac-83bc-4fe010edb3ba None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:39.072313 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 358/711] 10.222.0.23 () {56 vars in 1251 bytes} [Sat Oct 1 20:33:38 2022] GET /identity/v3/endpoints?service_id=2d4fcb7343204795b960456e85d3e224&interface=public®ion_id=RegionOne => generated 194 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:39.072313 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d04a3e4-43a5-40ac-83bc-4fe010edb3ba None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:39.123240 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae1c927-32a3-49ea-ad18-570011282f8f None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:39.124730 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:39.165263 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5252d971-5597-414c-80e1-37f74668bd73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:39.166530 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5252d971-5597-414c-80e1-37f74668bd73 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:39.167592 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5252d971-5597-414c-80e1-37f74668bd73 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:39.169520 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5252d971-5597-414c-80e1-37f74668bd73 None admin] PATH_INFO: `/v3/services` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:39.170642 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5252d971-5597-414c-80e1-37f74668bd73 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:39.172677 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5252d971-5597-414c-80e1-37f74668bd73 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:39.188554 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 354/712] 10.222.0.23 () {56 vars in 1087 bytes} [Sat Oct 1 20:33:39 2022] GET /identity/v3/services => generated 1002 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 20:33:39.188554 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5252d971-5597-414c-80e1-37f74668bd73 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:39.197855 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d04a3e4-43a5-40ac-83bc-4fe010edb3ba None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:39.202001 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:39.239857 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2754e1d-7e0f-44d2-bcb9-9f1825ce7761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:39.240790 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2754e1d-7e0f-44d2-bcb9-9f1825ce7761 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:39.241182 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2754e1d-7e0f-44d2-bcb9-9f1825ce7761 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:39.241567 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2754e1d-7e0f-44d2-bcb9-9f1825ce7761 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:39.254871 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2754e1d-7e0f-44d2-bcb9-9f1825ce7761 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 20:33:39.261004 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-d2754e1d-7e0f-44d2-bcb9-9f1825ce7761 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 20:33:39.261004 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:39.261004 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:39.261004 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:39.261004 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:39.261004 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:39.261004 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:39.261004 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:39.261004 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:39.261004 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:39.261004 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:39.261004 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:39.261004 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 20:33:39.261004 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 20:33:39.261004 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 20:33:39.261004 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 20:33:39.262662 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 20:33:39.262662 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 20:33:39.262662 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 20:33:39.262662 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 20:33:39.262662 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:39.262662 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:39.262662 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:39.262662 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:39.262662 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:39.262662 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:39.262662 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:39.262662 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:39.262662 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:39.262662 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:39.262662 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:39.262662 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:39.263852 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:39.263852 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:39.263852 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:39.263852 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:39.263852 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 20:33:39.263852 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 20:33:39.263852 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 20:33:39.263852 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 20:33:39.263852 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 20:33:39.263852 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 20:33:39.263852 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 20:33:39.263852 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:33:39.268731 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 359/713] 10.222.0.23 () {56 vars in 1096 bytes} [Sat Oct 1 20:33:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:39.270985 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2754e1d-7e0f-44d2-bcb9-9f1825ce7761 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:39.304676 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5252d971-5597-414c-80e1-37f74668bd73 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:39.355674 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbcb35b-88d4-4a88-b4ce-8e02052480dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:39.356465 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbcb35b-88d4-4a88-b4ce-8e02052480dd None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:39.356929 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbcb35b-88d4-4a88-b4ce-8e02052480dd None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:39.357177 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbcb35b-88d4-4a88-b4ce-8e02052480dd None admin] PATH_INFO: `/v3/services` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:39.357917 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbcb35b-88d4-4a88-b4ce-8e02052480dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:39.359436 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbcb35b-88d4-4a88-b4ce-8e02052480dd None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:39.366011 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 355/714] 10.222.0.23 () {56 vars in 1087 bytes} [Sat Oct 1 20:33:39 2022] GET /identity/v3/services => generated 1002 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 20:33:39.414863 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2754e1d-7e0f-44d2-bcb9-9f1825ce7761 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:39.458274 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef7320-84a3-4739-bfa4-5518f077b8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:39.459188 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef7320-84a3-4739-bfa4-5518f077b8c7 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:39.459618 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef7320-84a3-4739-bfa4-5518f077b8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:39.460037 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef7320-84a3-4739-bfa4-5518f077b8c7 None admin] PATH_INFO: `/v3/roles` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:39.460924 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ef7320-84a3-4739-bfa4-5518f077b8c7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:39.461379 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ef7320-84a3-4739-bfa4-5518f077b8c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:39.462953 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ef7320-84a3-4739-bfa4-5518f077b8c7 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:39.474013 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 360/715] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Oct 1 20:33:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:39.480005 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbcb35b-88d4-4a88-b4ce-8e02052480dd None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:39.516969 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:39.599293 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbcb35b-88d4-4a88-b4ce-8e02052480dd None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:39.636117 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beccbba-16e7-497f-8317-5c9f2c3f3c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:39.636800 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beccbba-16e7-497f-8317-5c9f2c3f3c2d None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:39.637145 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beccbba-16e7-497f-8317-5c9f2c3f3c2d None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:39.637410 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beccbba-16e7-497f-8317-5c9f2c3f3c2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:39.648153 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beccbba-16e7-497f-8317-5c9f2c3f3c2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:39.649663 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beccbba-16e7-497f-8317-5c9f2c3f3c2d None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:39.666635 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application [None req-5beccbba-16e7-497f-8317-5c9f2c3f3c2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:33:39.666635 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:39.666635 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:39.666635 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:39.666635 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:39.666635 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:39.666635 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:39.666635 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:39.666635 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:39.666635 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:39.666635 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:39.666635 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:39.666635 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 20:33:39.666635 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 20:33:39.666635 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 20:33:39.666635 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 20:33:39.667609 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:39.667609 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:39.667609 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:39.667609 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:39.667609 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:39.667609 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:39.667609 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:39.667609 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:39.667609 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:39.667609 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:39.667609 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:39.667609 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:39.667609 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:39.667609 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:39.667609 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:39.667609 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:39.667609 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 20:33:39.668778 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 20:33:39.668778 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:33:39.668778 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:33:39.668778 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 356/716] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Oct 1 20:33:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:39.675268 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef7320-84a3-4739-bfa4-5518f077b8c7 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:39.707749 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:39.785764 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef7320-84a3-4739-bfa4-5518f077b8c7 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:39.821950 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2633cae1-678e-44f4-b35d-c1b3f55efefd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:39.822968 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2633cae1-678e-44f4-b35d-c1b3f55efefd None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:39.823239 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2633cae1-678e-44f4-b35d-c1b3f55efefd None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:39.823492 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2633cae1-678e-44f4-b35d-c1b3f55efefd None admin] PATH_INFO: `/v3/domains` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:39.824126 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2633cae1-678e-44f4-b35d-c1b3f55efefd None admin] RBAC: Adding query filter params (name=Default) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:39.824428 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2633cae1-678e-44f4-b35d-c1b3f55efefd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:39.826755 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2633cae1-678e-44f4-b35d-c1b3f55efefd None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:39.839663 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 361/717] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Oct 1 20:33:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:39.846044 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beccbba-16e7-497f-8317-5c9f2c3f3c2d None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:39.935505 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:39.956029 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beccbba-16e7-497f-8317-5c9f2c3f3c2d None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:39.991907 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1f5f52-d3a3-46cb-ba9b-fa347ceb2c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:39.992552 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1f5f52-d3a3-46cb-ba9b-fa347ceb2c10 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:39.992840 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1f5f52-d3a3-46cb-ba9b-fa347ceb2c10 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:39.993110 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1f5f52-d3a3-46cb-ba9b-fa347ceb2c10 None admin] PATH_INFO: `/v3/users/nova` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:40.001297 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1f5f52-d3a3-46cb-ba9b-fa347ceb2c10 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:40.002751 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1f5f52-d3a3-46cb-ba9b-fa347ceb2c10 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:40.014764 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application [None req-ad1f5f52-d3a3-46cb-ba9b-fa347ceb2c10 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 01 20:33:40.014764 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:40.014764 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:40.014764 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:40.014764 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:40.014764 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:40.014764 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:40.014764 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:40.014764 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:40.014764 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:40.014764 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:40.014764 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:40.014764 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 01 20:33:40.014764 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 01 20:33:40.014764 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 01 20:33:40.014764 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 01 20:33:40.015779 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:40.015779 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:40.015779 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 01 20:33:40.015779 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 20:33:40.015779 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 01 20:33:40.015779 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 20:33:40.015779 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:40.015779 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:40.015779 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:40.015779 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:40.015779 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:40.015779 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:40.015779 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:40.015779 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:40.015779 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:40.015779 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:40.015779 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:40.015779 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:40.017830 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:40.017830 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:40.017830 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 01 20:33:40.017830 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 01 20:33:40.017830 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 01 20:33:40.017830 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 01 20:33:40.017830 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 01 20:33:40.017830 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 01 20:33:40.017830 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 01 20:33:40.017830 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:33:40.017830 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 357/718] 10.222.0.23 () {56 vars in 1093 bytes} [Sat Oct 1 20:33:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:40.021812 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2633cae1-678e-44f4-b35d-c1b3f55efefd None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:40.122294 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:40.140013 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2633cae1-678e-44f4-b35d-c1b3f55efefd None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:40.176263 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ce46b7-77df-49b5-93ed-4bc36d8d505a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:40.176263 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ce46b7-77df-49b5-93ed-4bc36d8d505a None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:40.176638 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ce46b7-77df-49b5-93ed-4bc36d8d505a None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:40.178213 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ce46b7-77df-49b5-93ed-4bc36d8d505a None admin] PATH_INFO: `/v3/users` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:40.178213 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ce46b7-77df-49b5-93ed-4bc36d8d505a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:40.178213 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ce46b7-77df-49b5-93ed-4bc36d8d505a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:40.179252 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ce46b7-77df-49b5-93ed-4bc36d8d505a None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:40.198506 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 362/719] 10.222.0.23 () {56 vars in 1133 bytes} [Sat Oct 1 20:33:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:40.204784 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1f5f52-d3a3-46cb-ba9b-fa347ceb2c10 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:40.310403 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1f5f52-d3a3-46cb-ba9b-fa347ceb2c10 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:40.346346 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e1a5cb-3f04-47b8-9b0d-4cc481ebf675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:40.346949 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1a5cb-3f04-47b8-9b0d-4cc481ebf675 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:40.347226 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1a5cb-3f04-47b8-9b0d-4cc481ebf675 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:40.347500 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1a5cb-3f04-47b8-9b0d-4cc481ebf675 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:40.359783 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:40.420256 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e1a5cb-3f04-47b8-9b0d-4cc481ebf675 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:40.421782 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e1a5cb-3f04-47b8-9b0d-4cc481ebf675 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:40.535087 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 358/720] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Oct 1 20:33:40 2022] GET /identity/v3/auth/tokens => generated 1098 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 01 20:33:40.541010 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ce46b7-77df-49b5-93ed-4bc36d8d505a None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:40.653895 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ce46b7-77df-49b5-93ed-4bc36d8d505a None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:40.690932 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640750cd-8c5a-4032-9db4-8e9127dfb1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:40.691950 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640750cd-8c5a-4032-9db4-8e9127dfb1ac None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:40.692718 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640750cd-8c5a-4032-9db4-8e9127dfb1ac None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:40.693211 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640750cd-8c5a-4032-9db4-8e9127dfb1ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:40.704930 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640750cd-8c5a-4032-9db4-8e9127dfb1ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:40.706713 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640750cd-8c5a-4032-9db4-8e9127dfb1ac None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:40.709613 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:40.724656 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-640750cd-8c5a-4032-9db4-8e9127dfb1ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:33:40.724656 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:40.724656 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:40.724656 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:40.724656 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:40.724656 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:40.724656 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:40.724656 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:40.724656 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:40.724656 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:40.724656 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:40.724656 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:40.724656 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 20:33:40.724656 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 20:33:40.724656 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 20:33:40.724656 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 20:33:40.725689 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:40.725689 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:40.725689 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:40.725689 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:40.725689 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:40.725689 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:40.725689 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:40.725689 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:40.725689 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:40.725689 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:40.725689 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:40.725689 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:40.725689 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:40.725689 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:40.725689 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:40.725689 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:40.725689 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 20:33:40.726650 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 20:33:40.726650 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:33:40.726650 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:33:40.728932 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 363/721] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Oct 1 20:33:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:40.736698 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e1a5cb-3f04-47b8-9b0d-4cc481ebf675 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:40.788445 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:40.852345 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e1a5cb-3f04-47b8-9b0d-4cc481ebf675 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:40.888471 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc31b466-9b54-49f8-a4c8-5e2b1f3d89cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:40.889129 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc31b466-9b54-49f8-a4c8-5e2b1f3d89cd None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:40.889406 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc31b466-9b54-49f8-a4c8-5e2b1f3d89cd None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:40.889678 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc31b466-9b54-49f8-a4c8-5e2b1f3d89cd None admin] PATH_INFO: `/v3/domains` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:40.890304 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc31b466-9b54-49f8-a4c8-5e2b1f3d89cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:40.890603 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc31b466-9b54-49f8-a4c8-5e2b1f3d89cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:40.891975 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc31b466-9b54-49f8-a4c8-5e2b1f3d89cd None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:40.904186 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 359/722] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Oct 1 20:33:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:40.909704 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640750cd-8c5a-4032-9db4-8e9127dfb1ac None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:41.013455 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640750cd-8c5a-4032-9db4-8e9127dfb1ac None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:41.049945 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60362d4-84ba-4d15-bceb-469440adce5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:41.050496 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60362d4-84ba-4d15-bceb-469440adce5f None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:41.050771 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60362d4-84ba-4d15-bceb-469440adce5f None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:41.051049 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60362d4-84ba-4d15-bceb-469440adce5f None admin] PATH_INFO: `/v3/projects/service` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:41.057844 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60362d4-84ba-4d15-bceb-469440adce5f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:41.059973 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60362d4-84ba-4d15-bceb-469440adce5f None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:41.071416 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-f60362d4-84ba-4d15-bceb-469440adce5f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 20:33:41.071416 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:41.071416 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:41.071416 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:41.071416 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:41.071416 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:41.071416 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:41.071416 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:41.071416 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:41.071416 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:41.071416 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:41.071416 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:41.071416 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 01 20:33:41.071416 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 01 20:33:41.071416 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 01 20:33:41.072319 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 01 20:33:41.072319 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:41.072319 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:41.072319 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:41.072319 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:41.072319 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:41.072319 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:41.072319 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:41.072319 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:41.072319 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:41.072319 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:41.072319 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:41.072319 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:41.072319 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:41.072319 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:41.072319 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:41.072319 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:41.073807 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 01 20:33:41.073807 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 01 20:33:41.073807 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 01 20:33:41.073807 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 01 20:33:41.073807 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 01 20:33:41.073807 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 01 20:33:41.073807 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 20:33:41.073807 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:33:41.073807 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 364/723] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Oct 1 20:33:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:41.078819 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc31b466-9b54-49f8-a4c8-5e2b1f3d89cd None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:41.183673 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc31b466-9b54-49f8-a4c8-5e2b1f3d89cd None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:41.185822 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:41.220110 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a809745-3474-45a9-8a7f-a81350e8c7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:41.220741 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a809745-3474-45a9-8a7f-a81350e8c7f8 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:41.221074 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a809745-3474-45a9-8a7f-a81350e8c7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:41.221350 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a809745-3474-45a9-8a7f-a81350e8c7f8 None admin] PATH_INFO: `/v3/projects` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:41.222036 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a809745-3474-45a9-8a7f-a81350e8c7f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:41.222332 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a809745-3474-45a9-8a7f-a81350e8c7f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:41.223761 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a809745-3474-45a9-8a7f-a81350e8c7f8 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:41.236780 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 360/724] 10.222.0.23 () {56 vars in 1148 bytes} [Sat Oct 1 20:33:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:41.243043 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60362d4-84ba-4d15-bceb-469440adce5f None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:41.259245 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65737d42-d777-4cb2-850a-6ea9a6b70f10 None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:41.259552 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65737d42-d777-4cb2-850a-6ea9a6b70f10 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:41.259804 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65737d42-d777-4cb2-850a-6ea9a6b70f10 None None] PATH_INFO: `/` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:41.262454 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 361/725] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:33:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 01 20:33:41.268285 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f0136-2877-4576-984a-22409e3147ba None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:41.268589 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f0136-2877-4576-984a-22409e3147ba None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:41.268864 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f0136-2877-4576-984a-22409e3147ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:41.292561 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-d13f0136-2877-4576-984a-22409e3147ba None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:33:41.293808 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-d13f0136-2877-4576-984a-22409e3147ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:33:41.316452 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:41.365570 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60362d4-84ba-4d15-bceb-469440adce5f None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:41.384100 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 362/726] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:33:41 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 01 20:33:41.407147 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bc05e9-874f-43d8-a7f2-8e4b4e6cf3c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:41.408027 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bc05e9-874f-43d8-a7f2-8e4b4e6cf3c0 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:41.408454 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bc05e9-874f-43d8-a7f2-8e4b4e6cf3c0 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:41.408985 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bc05e9-874f-43d8-a7f2-8e4b4e6cf3c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:41.409848 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bc05e9-874f-43d8-a7f2-8e4b4e6cf3c0 None admin] RBAC: Adding query filter params (role.id=d11e7ba2f1fa41ff8ea8dda2a8d1466f, scope.project.id=8f242c4eeaa04ed19dcdc8ba95b86cfb, user.id=b9c31d26f19d46f09e2f2e5e660234f2) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:41.410299 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bc05e9-874f-43d8-a7f2-8e4b4e6cf3c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:41.411966 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bc05e9-874f-43d8-a7f2-8e4b4e6cf3c0 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:41.418592 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 365/727] 10.222.0.23 () {56 vars in 1374 bytes} [Sat Oct 1 20:33:41 2022] GET /identity/v3/role_assignments?user.id=b9c31d26f19d46f09e2f2e5e660234f2&scope.project.id=8f242c4eeaa04ed19dcdc8ba95b86cfb&role.id=d11e7ba2f1fa41ff8ea8dda2a8d1466f => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:41.719486 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13f0136-2877-4576-984a-22409e3147ba None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:41.821328 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:41.830824 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13f0136-2877-4576-984a-22409e3147ba None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:41.869859 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40930855-62a1-4d88-aa55-334496361147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:41.870500 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40930855-62a1-4d88-aa55-334496361147 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:41.870773 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40930855-62a1-4d88-aa55-334496361147 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:41.871181 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40930855-62a1-4d88-aa55-334496361147 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:41.872515 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40930855-62a1-4d88-aa55-334496361147 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:41.874088 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40930855-62a1-4d88-aa55-334496361147 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:41.883353 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application [None req-40930855-62a1-4d88-aa55-334496361147 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 01 20:33:41.883353 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:41.883353 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 01 20:33:41.883353 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 01 20:33:41.883353 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 01 20:33:41.883353 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 01 20:33:41.883353 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 01 20:33:41.883353 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 01 20:33:41.883353 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 01 20:33:41.883353 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:33:41.883353 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 01 20:33:41.883353 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:33:41.883353 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:41.883353 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:41.883353 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:41.883353 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:41.883353 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:41.884332 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:41.884332 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:41.884332 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:41.884332 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:41.884332 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:41.884332 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:41.884332 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 01 20:33:41.884332 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 01 20:33:41.884332 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 01 20:33:41.884332 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 01 20:33:41.884332 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:41.884332 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:41.884332 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:41.884332 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:41.884332 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:41.884332 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:41.885219 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:41.885219 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:41.885219 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:41.885219 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:41.885219 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:41.885219 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:41.885219 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:41.885219 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:41.885219 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:41.885219 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:41.885219 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 01 20:33:41.885219 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 01 20:33:41.885219 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 01 20:33:41.885219 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:33:41.885219 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 363/728] 10.222.0.23 () {56 vars in 1129 bytes} [Sat Oct 1 20:33:41 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:41.890898 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bc05e9-874f-43d8-a7f2-8e4b4e6cf3c0 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:41.942567 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac782e-e6ff-4842-96c4-e6e49dd305f6 None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:41.942845 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac782e-e6ff-4842-96c4-e6e49dd305f6 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:41.943283 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac782e-e6ff-4842-96c4-e6e49dd305f6 None None] PATH_INFO: `/` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:41.944972 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 364/729] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:33:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 01 20:33:41.951238 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad5e66a-ced0-4307-835a-846824e16762 None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:41.951584 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad5e66a-ced0-4307-835a-846824e16762 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:41.951929 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad5e66a-ced0-4307-835a-846824e16762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:41.971400 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-7ad5e66a-ced0-4307-835a-846824e16762 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:33:41.972748 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-7ad5e66a-ced0-4307-835a-846824e16762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:33:41.999073 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bc05e9-874f-43d8-a7f2-8e4b4e6cf3c0 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:42.021206 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:42.037723 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac53e87-951d-4181-a8a4-f9a4329a84ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:42.038629 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac53e87-951d-4181-a8a4-f9a4329a84ea None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:42.038921 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac53e87-951d-4181-a8a4-f9a4329a84ea None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:42.039195 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac53e87-951d-4181-a8a4-f9a4329a84ea None admin] PATH_INFO: `/v3/services` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:42.039816 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac53e87-951d-4181-a8a4-f9a4329a84ea None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:42.040142 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac53e87-951d-4181-a8a4-f9a4329a84ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:42.041538 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac53e87-951d-4181-a8a4-f9a4329a84ea None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:42.050880 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 365/730] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:33:41 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 01 20:33:42.051099 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 366/731] 10.222.0.23 () {56 vars in 1124 bytes} [Sat Oct 1 20:33:41 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:42.052101 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad5e66a-ced0-4307-835a-846824e16762 None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:42.052268 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25293395-a971-4dbf-a847-2874a10ba61d None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:42.052632 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25293395-a971-4dbf-a847-2874a10ba61d None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:42.052915 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25293395-a971-4dbf-a847-2874a10ba61d None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:42.054368 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 367/732] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:33:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:33:42.066464 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08efbf6e-1b9d-4496-8b10-0bd6cb287154 None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:42.066464 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08efbf6e-1b9d-4496-8b10-0bd6cb287154 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:42.066464 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08efbf6e-1b9d-4496-8b10-0bd6cb287154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:42.078968 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-08efbf6e-1b9d-4496-8b10-0bd6cb287154 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:33:42.080396 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-08efbf6e-1b9d-4496-8b10-0bd6cb287154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:33:42.155988 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:42.170732 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 368/733] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:33:42 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 01 20:33:42.183568 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad5e66a-ced0-4307-835a-846824e16762 None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:42.220543 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a5cb1c-5dd9-4c65-b4f5-bcc03b11faa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:42.221193 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a5cb1c-5dd9-4c65-b4f5-bcc03b11faa2 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:42.221528 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a5cb1c-5dd9-4c65-b4f5-bcc03b11faa2 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:42.221744 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a5cb1c-5dd9-4c65-b4f5-bcc03b11faa2 None admin] PATH_INFO: `/v3/services` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:42.222424 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a5cb1c-5dd9-4c65-b4f5-bcc03b11faa2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:42.222731 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a5cb1c-5dd9-4c65-b4f5-bcc03b11faa2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:42.224105 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a5cb1c-5dd9-4c65-b4f5-bcc03b11faa2 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:42.229664 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 366/734] 10.222.0.23 () {56 vars in 1124 bytes} [Sat Oct 1 20:33:42 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:42.235500 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08efbf6e-1b9d-4496-8b10-0bd6cb287154 None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:42.335441 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08efbf6e-1b9d-4496-8b10-0bd6cb287154 None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:42.350040 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:42.370824 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a893fc-84e5-41cc-b276-fbb3fccb442c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:42.371983 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a893fc-84e5-41cc-b276-fbb3fccb442c None admin] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:42.372258 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a893fc-84e5-41cc-b276-fbb3fccb442c None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:42.372556 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a893fc-84e5-41cc-b276-fbb3fccb442c None admin] PATH_INFO: `/v3/endpoints` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:42.373471 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a893fc-84e5-41cc-b276-fbb3fccb442c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:42.374829 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a893fc-84e5-41cc-b276-fbb3fccb442c None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:42.398283 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 369/735] 10.222.0.23 () {60 vars in 1144 bytes} [Sat Oct 1 20:33:42 2022] POST /identity/v3/endpoints => generated 346 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 20:33:42.421626 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a5cb1c-5dd9-4c65-b4f5-bcc03b11faa2 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:42.525332 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a893fc-84e5-41cc-b276-fbb3fccb442c None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:42.551098 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a5cb1c-5dd9-4c65-b4f5-bcc03b11faa2 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:42.596926 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbddfc0e-e0be-47f9-a773-d76988b565e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:42.597575 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbddfc0e-e0be-47f9-a773-d76988b565e6 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:42.597852 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbddfc0e-e0be-47f9-a773-d76988b565e6 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:42.598124 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbddfc0e-e0be-47f9-a773-d76988b565e6 None admin] PATH_INFO: `/v3/services/image` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:42.598719 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbddfc0e-e0be-47f9-a773-d76988b565e6 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:42.600176 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbddfc0e-e0be-47f9-a773-d76988b565e6 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:42.611251 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application [None req-dbddfc0e-e0be-47f9-a773-d76988b565e6 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 01 20:33:42.611251 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:42.611251 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 01 20:33:42.611251 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 01 20:33:42.611251 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 01 20:33:42.611251 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 01 20:33:42.611251 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 01 20:33:42.611251 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 01 20:33:42.611251 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 01 20:33:42.611251 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:33:42.611251 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 01 20:33:42.611251 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:33:42.611251 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:42.611251 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:42.611251 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:42.611251 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:42.611251 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:42.612738 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:42.612738 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:42.612738 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:42.612738 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:42.612738 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:42.612738 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:42.612738 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 01 20:33:42.612738 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 01 20:33:42.612738 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 01 20:33:42.612738 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 01 20:33:42.612738 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:42.612738 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:42.612738 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:42.612738 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:42.612738 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:42.612738 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:42.613725 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:42.613725 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:42.613725 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:42.613725 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:42.613725 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:42.613725 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:42.613725 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:42.613725 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:42.613725 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:42.613725 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:42.613725 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 01 20:33:42.613725 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 01 20:33:42.613725 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 01 20:33:42.613725 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:33:42.613725 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 367/736] 10.222.0.23 () {56 vars in 1105 bytes} [Sat Oct 1 20:33:42 2022] GET /identity/v3/services/image => generated 86 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:42.619116 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbddfc0e-e0be-47f9-a773-d76988b565e6 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:42.636397 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:42.650558 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a893fc-84e5-41cc-b276-fbb3fccb442c None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:42.688890 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42383746-21ad-47d6-9eef-42f0c5918076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:42.689901 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42383746-21ad-47d6-9eef-42f0c5918076 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:42.690240 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42383746-21ad-47d6-9eef-42f0c5918076 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:42.690584 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42383746-21ad-47d6-9eef-42f0c5918076 None admin] PATH_INFO: `/v3/services/network` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:42.691243 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42383746-21ad-47d6-9eef-42f0c5918076 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:42.692904 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42383746-21ad-47d6-9eef-42f0c5918076 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:42.703243 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-42383746-21ad-47d6-9eef-42f0c5918076 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 01 20:33:42.703243 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:42.703243 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 01 20:33:42.703243 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 01 20:33:42.703243 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 01 20:33:42.703243 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 01 20:33:42.703243 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 01 20:33:42.703243 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 01 20:33:42.703243 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 01 20:33:42.703243 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:33:42.703243 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 01 20:33:42.703243 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:33:42.703243 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:42.703243 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:42.703243 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:42.703243 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:42.703243 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:42.704311 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:42.704311 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:42.704311 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:42.704311 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:42.704311 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:42.704311 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:42.704311 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 01 20:33:42.704311 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 01 20:33:42.704311 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 01 20:33:42.704311 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 01 20:33:42.704311 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:42.704311 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:42.704311 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:42.704311 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:42.704311 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:42.704311 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:42.705257 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:42.705257 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:42.705257 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:42.705257 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:42.705257 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:42.705257 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:42.705257 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:42.705257 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:42.705257 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:42.705257 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:42.705257 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 01 20:33:42.705257 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 01 20:33:42.705257 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 01 20:33:42.705257 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:33:42.705257 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 370/737] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Oct 1 20:33:42 2022] GET /identity/v3/services/network => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 01 20:33:42.710619 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42383746-21ad-47d6-9eef-42f0c5918076 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:42.738631 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbddfc0e-e0be-47f9-a773-d76988b565e6 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:42.752175 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:42.792632 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac86ecf-210d-4aa5-9f86-aef4adefd867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:42.793707 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac86ecf-210d-4aa5-9f86-aef4adefd867 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:42.794082 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac86ecf-210d-4aa5-9f86-aef4adefd867 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:42.794358 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac86ecf-210d-4aa5-9f86-aef4adefd867 None admin] PATH_INFO: `/v3/services` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:42.795090 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac86ecf-210d-4aa5-9f86-aef4adefd867 None admin] RBAC: Adding query filter params (name=image) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:42.795416 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac86ecf-210d-4aa5-9f86-aef4adefd867 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:42.796821 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac86ecf-210d-4aa5-9f86-aef4adefd867 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:42.809635 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 368/738] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Oct 1 20:33:42 2022] GET /identity/v3/services?name=image => generated 122 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 20:33:42.811269 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac86ecf-210d-4aa5-9f86-aef4adefd867 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:42.854871 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42383746-21ad-47d6-9eef-42f0c5918076 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:42.893105 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567aff40-1199-4ac4-bb5f-9d7bfcd1194c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:42.893744 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567aff40-1199-4ac4-bb5f-9d7bfcd1194c None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:42.893980 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567aff40-1199-4ac4-bb5f-9d7bfcd1194c None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:42.894256 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567aff40-1199-4ac4-bb5f-9d7bfcd1194c None admin] PATH_INFO: `/v3/services` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:42.894891 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567aff40-1199-4ac4-bb5f-9d7bfcd1194c None admin] RBAC: Adding query filter params (name=network) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:42.895472 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567aff40-1199-4ac4-bb5f-9d7bfcd1194c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:42.896593 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567aff40-1199-4ac4-bb5f-9d7bfcd1194c None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:42.901908 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 371/739] 10.222.0.23 () {56 vars in 1112 bytes} [Sat Oct 1 20:33:42 2022] GET /identity/v3/services?name=network => generated 124 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:42.908055 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567aff40-1199-4ac4-bb5f-9d7bfcd1194c None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:42.914202 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:42.942451 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac86ecf-210d-4aa5-9f86-aef4adefd867 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:42.980082 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b777d3-5a97-459d-a654-d055540b719e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:42.981356 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b777d3-5a97-459d-a654-d055540b719e None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:42.981835 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b777d3-5a97-459d-a654-d055540b719e None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:42.982382 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b777d3-5a97-459d-a654-d055540b719e None admin] PATH_INFO: `/v3/services` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:42.983213 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b777d3-5a97-459d-a654-d055540b719e None admin] RBAC: Adding query filter params (type=image) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:42.983706 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b777d3-5a97-459d-a654-d055540b719e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:42.985288 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b777d3-5a97-459d-a654-d055540b719e None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:42.995299 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 369/740] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Oct 1 20:33:42 2022] GET /identity/v3/services?type=image => generated 350 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:42.996453 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b777d3-5a97-459d-a654-d055540b719e None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:43.013204 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:43.017666 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567aff40-1199-4ac4-bb5f-9d7bfcd1194c None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:43.054601 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25d861f-513b-4705-99e9-2da0740b97e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:43.055153 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25d861f-513b-4705-99e9-2da0740b97e9 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:43.055433 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25d861f-513b-4705-99e9-2da0740b97e9 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:43.055709 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25d861f-513b-4705-99e9-2da0740b97e9 None admin] PATH_INFO: `/v3/services` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:43.056395 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25d861f-513b-4705-99e9-2da0740b97e9 None admin] RBAC: Adding query filter params (type=network) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:43.056827 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25d861f-513b-4705-99e9-2da0740b97e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:43.058312 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25d861f-513b-4705-99e9-2da0740b97e9 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:43.068726 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 372/741] 10.222.0.23 () {56 vars in 1112 bytes} [Sat Oct 1 20:33:42 2022] GET /identity/v3/services?type=network => generated 350 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 20:33:43.069533 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25d861f-513b-4705-99e9-2da0740b97e9 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:43.112005 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b777d3-5a97-459d-a654-d055540b719e None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:43.149000 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0afd5c-bf93-43c7-ba98-7ddad6efa2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:43.149965 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0afd5c-bf93-43c7-ba98-7ddad6efa2f4 None admin] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:43.150509 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0afd5c-bf93-43c7-ba98-7ddad6efa2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:43.150993 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0afd5c-bf93-43c7-ba98-7ddad6efa2f4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:43.151942 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0afd5c-bf93-43c7-ba98-7ddad6efa2f4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:43.154271 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0afd5c-bf93-43c7-ba98-7ddad6efa2f4 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:43.163598 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:43.186605 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25d861f-513b-4705-99e9-2da0740b97e9 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:43.197036 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 370/742] 10.222.0.23 () {60 vars in 1144 bytes} [Sat Oct 1 20:33:42 2022] POST /identity/v3/endpoints => generated 327 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 20:33:43.235641 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b8b8de-3d00-4ce8-8341-4fae89e55655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:43.236267 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b8b8de-3d00-4ce8-8341-4fae89e55655 None admin] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:43.236567 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b8b8de-3d00-4ce8-8341-4fae89e55655 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:43.236846 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b8b8de-3d00-4ce8-8341-4fae89e55655 None admin] PATH_INFO: `/v3/endpoints` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:43.237541 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b8b8de-3d00-4ce8-8341-4fae89e55655 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:43.239064 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b8b8de-3d00-4ce8-8341-4fae89e55655 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:43.266828 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 373/743] 10.222.0.23 () {60 vars in 1144 bytes} [Sat Oct 1 20:33:43 2022] POST /identity/v3/endpoints => generated 337 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 20:33:44.002388 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde6b2f-4912-4258-bbf6-12b26a87efd1 None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:44.002913 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde6b2f-4912-4258-bbf6-12b26a87efd1 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:44.003227 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde6b2f-4912-4258-bbf6-12b26a87efd1 None None] PATH_INFO: `/` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:44.004476 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 371/744] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:33:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:33:44.009828 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a424eb8d-eabd-4b77-9bb7-258d69a6ba00 None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:44.010253 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a424eb8d-eabd-4b77-9bb7-258d69a6ba00 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:44.010422 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a424eb8d-eabd-4b77-9bb7-258d69a6ba00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:44.028965 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-a424eb8d-eabd-4b77-9bb7-258d69a6ba00 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:33:44.030165 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-a424eb8d-eabd-4b77-9bb7-258d69a6ba00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:33:44.040284 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:44.106389 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 374/745] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:33:44 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 01 20:33:44.430656 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dde6b2f-4912-4258-bbf6-12b26a87efd1 None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:44.541905 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dde6b2f-4912-4258-bbf6-12b26a87efd1 None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:44.576542 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9170a574-ce38-4735-ba8e-4c578de87c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:44.577167 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9170a574-ce38-4735-ba8e-4c578de87c60 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:44.577444 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9170a574-ce38-4735-ba8e-4c578de87c60 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:44.577715 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9170a574-ce38-4735-ba8e-4c578de87c60 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:44.578289 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9170a574-ce38-4735-ba8e-4c578de87c60 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:44.579656 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9170a574-ce38-4735-ba8e-4c578de87c60 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:44.588490 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application [None req-9170a574-ce38-4735-ba8e-4c578de87c60 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 01 20:33:44.588490 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:44.588490 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 01 20:33:44.588490 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 01 20:33:44.588490 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 01 20:33:44.588490 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 01 20:33:44.588490 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 01 20:33:44.588490 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 01 20:33:44.588490 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 01 20:33:44.588490 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:33:44.588490 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 01 20:33:44.588490 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:33:44.588490 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:44.588490 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:44.588490 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:44.588490 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:44.589456 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:44.589456 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:44.589456 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:44.589456 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:44.589456 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:44.589456 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:44.589456 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:44.589456 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 01 20:33:44.589456 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 01 20:33:44.589456 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 01 20:33:44.589456 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 01 20:33:44.589456 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:44.589456 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:44.589456 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:44.589456 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:44.589456 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:44.589456 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:44.590969 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:44.590969 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:44.590969 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:44.590969 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:44.590969 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:44.590969 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:44.590969 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:44.590969 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:44.590969 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:44.590969 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:44.590969 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 01 20:33:44.590969 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 01 20:33:44.590969 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 01 20:33:44.590969 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:33:44.592626 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 372/746] 10.222.0.23 () {56 vars in 1132 bytes} [Sat Oct 1 20:33:44 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:44.596500 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a424eb8d-eabd-4b77-9bb7-258d69a6ba00 None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:44.706838 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a424eb8d-eabd-4b77-9bb7-258d69a6ba00 None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:44.740890 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11daf66-d7c8-4959-9b61-ada27fec868f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:44.741490 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11daf66-d7c8-4959-9b61-ada27fec868f None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:44.741767 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11daf66-d7c8-4959-9b61-ada27fec868f None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:44.742036 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11daf66-d7c8-4959-9b61-ada27fec868f None admin] PATH_INFO: `/v3/services` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:44.742660 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11daf66-d7c8-4959-9b61-ada27fec868f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:44.743015 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11daf66-d7c8-4959-9b61-ada27fec868f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:44.744391 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11daf66-d7c8-4959-9b61-ada27fec868f None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:44.749673 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 375/747] 10.222.0.23 () {56 vars in 1126 bytes} [Sat Oct 1 20:33:44 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:44.755309 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9170a574-ce38-4735-ba8e-4c578de87c60 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:44.819744 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:44.863895 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9170a574-ce38-4735-ba8e-4c578de87c60 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:44.897585 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba63b36-a629-4c30-8d23-0282bef99c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:44.898187 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba63b36-a629-4c30-8d23-0282bef99c95 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:44.898518 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba63b36-a629-4c30-8d23-0282bef99c95 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:44.898790 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba63b36-a629-4c30-8d23-0282bef99c95 None admin] PATH_INFO: `/v3/services` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:44.899503 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba63b36-a629-4c30-8d23-0282bef99c95 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:44.899812 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba63b36-a629-4c30-8d23-0282bef99c95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:44.901213 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba63b36-a629-4c30-8d23-0282bef99c95 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:44.906831 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 373/748] 10.222.0.23 () {56 vars in 1126 bytes} [Sat Oct 1 20:33:44 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:44.929667 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d969c210-0d52-4c94-86b7-3065a5520f00 None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:44.929976 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d969c210-0d52-4c94-86b7-3065a5520f00 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:44.930212 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d969c210-0d52-4c94-86b7-3065a5520f00 None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:44.931749 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 376/749] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:33:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:33:44.937421 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a0fc6c-be66-4927-94c5-3e91783c8ad4 None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:44.937710 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a0fc6c-be66-4927-94c5-3e91783c8ad4 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:44.937976 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a0fc6c-be66-4927-94c5-3e91783c8ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:44.957452 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-95a0fc6c-be66-4927-94c5-3e91783c8ad4 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:33:44.958567 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-95a0fc6c-be66-4927-94c5-3e91783c8ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:33:45.034151 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 374/750] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:33:44 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 01 20:33:45.356749 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d969c210-0d52-4c94-86b7-3065a5520f00 None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:45.365693 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:45.469918 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d969c210-0d52-4c94-86b7-3065a5520f00 None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:45.506806 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8081b78b-9915-4f28-bd3d-b4a37bbc4c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:45.507433 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8081b78b-9915-4f28-bd3d-b4a37bbc4c72 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:45.507708 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8081b78b-9915-4f28-bd3d-b4a37bbc4c72 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:45.507976 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8081b78b-9915-4f28-bd3d-b4a37bbc4c72 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:45.508580 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8081b78b-9915-4f28-bd3d-b4a37bbc4c72 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:45.509940 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8081b78b-9915-4f28-bd3d-b4a37bbc4c72 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:45.518644 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-8081b78b-9915-4f28-bd3d-b4a37bbc4c72 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 01 20:33:45.518644 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:45.518644 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 01 20:33:45.518644 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 01 20:33:45.518644 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 01 20:33:45.518644 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 01 20:33:45.518644 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 01 20:33:45.518644 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 01 20:33:45.518644 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 01 20:33:45.518644 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:33:45.518644 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 01 20:33:45.518644 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:33:45.518644 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:45.518644 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:45.518644 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:45.518644 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:45.518644 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:45.519714 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:45.519714 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:45.519714 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:45.519714 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:45.519714 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:45.519714 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:45.519714 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 01 20:33:45.519714 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 01 20:33:45.519714 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 01 20:33:45.519714 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 01 20:33:45.519714 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:45.519714 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:45.519714 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:45.519714 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:45.519714 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:45.519714 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:45.521050 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:45.521050 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:45.521050 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:45.521050 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:45.521050 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:45.521050 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:45.521050 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:45.521050 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:45.521050 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:45.521050 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:45.521050 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 01 20:33:45.521050 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 01 20:33:45.521050 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 01 20:33:45.521050 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:33:45.522282 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 377/751] 10.222.0.23 () {56 vars in 1114 bytes} [Sat Oct 1 20:33:45 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:45.525614 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a0fc6c-be66-4927-94c5-3e91783c8ad4 None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:45.578487 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:45.626650 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a0fc6c-be66-4927-94c5-3e91783c8ad4 None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:45.661181 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6ce5e6-8d3f-4bb4-bfff-6ab6621eb86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:45.661787 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ce5e6-8d3f-4bb4-bfff-6ab6621eb86c None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:45.662061 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ce5e6-8d3f-4bb4-bfff-6ab6621eb86c None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:45.662329 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ce5e6-8d3f-4bb4-bfff-6ab6621eb86c None admin] PATH_INFO: `/v3/services` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:45.662945 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6ce5e6-8d3f-4bb4-bfff-6ab6621eb86c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:45.663245 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6ce5e6-8d3f-4bb4-bfff-6ab6621eb86c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:45.664646 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6ce5e6-8d3f-4bb4-bfff-6ab6621eb86c None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:45.669562 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 375/752] 10.222.0.23 () {56 vars in 1114 bytes} [Sat Oct 1 20:33:45 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 20:33:45.674982 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8081b78b-9915-4f28-bd3d-b4a37bbc4c72 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:45.681085 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3ff215-d1a6-46ab-9273-75b780af4c9c None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:45.681368 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3ff215-d1a6-46ab-9273-75b780af4c9c None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:45.681625 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3ff215-d1a6-46ab-9273-75b780af4c9c None None] PATH_INFO: `/` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:45.683116 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 376/753] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:33:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 01 20:33:45.689208 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc72dde7-2a21-4c50-b956-458d43b3b751 None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:45.689652 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc72dde7-2a21-4c50-b956-458d43b3b751 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:45.690048 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc72dde7-2a21-4c50-b956-458d43b3b751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:45.709028 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-cc72dde7-2a21-4c50-b956-458d43b3b751 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:33:45.710221 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-cc72dde7-2a21-4c50-b956-458d43b3b751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:33:45.747558 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:45.783902 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8081b78b-9915-4f28-bd3d-b4a37bbc4c72 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:45.785707 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 377/754] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:33:45 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 01 20:33:45.817460 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2927cc2-ed0b-40b2-adb3-9e8b905ab506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:45.818058 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2927cc2-ed0b-40b2-adb3-9e8b905ab506 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:45.818355 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2927cc2-ed0b-40b2-adb3-9e8b905ab506 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:45.818595 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2927cc2-ed0b-40b2-adb3-9e8b905ab506 None admin] PATH_INFO: `/v3/services` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:45.819208 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2927cc2-ed0b-40b2-adb3-9e8b905ab506 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:45.819524 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2927cc2-ed0b-40b2-adb3-9e8b905ab506 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:45.820876 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2927cc2-ed0b-40b2-adb3-9e8b905ab506 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:45.825964 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 378/755] 10.222.0.23 () {56 vars in 1114 bytes} [Sat Oct 1 20:33:45 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:46.116812 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc72dde7-2a21-4c50-b956-458d43b3b751 None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:46.166941 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:46.225620 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc72dde7-2a21-4c50-b956-458d43b3b751 None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:46.259462 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51f5333-8ffe-4e49-ad92-04dec37e0fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:46.260057 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51f5333-8ffe-4e49-ad92-04dec37e0fb9 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:46.260330 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51f5333-8ffe-4e49-ad92-04dec37e0fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:46.260622 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51f5333-8ffe-4e49-ad92-04dec37e0fb9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:46.327245 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51f5333-8ffe-4e49-ad92-04dec37e0fb9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:46.328735 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51f5333-8ffe-4e49-ad92-04dec37e0fb9 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:46.374348 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:46.428362 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 378/756] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Oct 1 20:33:46 2022] GET /identity/v3/auth/tokens => generated 1406 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 01 20:33:46.434357 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2927cc2-ed0b-40b2-adb3-9e8b905ab506 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:46.541820 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2927cc2-ed0b-40b2-adb3-9e8b905ab506 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:46.570666 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:46.577178 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0896026-ba57-482c-bc82-129125976d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:46.577803 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0896026-ba57-482c-bc82-129125976d64 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:46.578076 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0896026-ba57-482c-bc82-129125976d64 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:46.578342 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0896026-ba57-482c-bc82-129125976d64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:46.589066 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0896026-ba57-482c-bc82-129125976d64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:46.590556 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0896026-ba57-482c-bc82-129125976d64 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:46.604470 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-f0896026-ba57-482c-bc82-129125976d64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:33:46.604470 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:46.604470 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:46.604470 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:46.604470 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:46.604470 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:46.604470 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:46.604470 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:46.604470 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:46.604470 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:46.604470 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:46.604470 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:46.604470 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 20:33:46.604470 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 20:33:46.604470 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 20:33:46.604470 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 20:33:46.605952 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:46.605952 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:46.605952 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:46.605952 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:46.605952 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:46.605952 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:46.605952 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:46.605952 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:46.605952 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:46.605952 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:46.605952 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:46.605952 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:46.605952 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:46.605952 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:46.605952 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:46.605952 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:46.605952 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 20:33:46.606994 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 20:33:46.606994 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:33:46.606994 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:33:46.607716 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 379/757] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Oct 1 20:33:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:46.611883 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51f5333-8ffe-4e49-ad92-04dec37e0fb9 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:46.715886 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51f5333-8ffe-4e49-ad92-04dec37e0fb9 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:46.750231 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f93f0-79e1-449a-9842-5fe86fe6b99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:46.750834 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f93f0-79e1-449a-9842-5fe86fe6b99e None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:46.751113 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f93f0-79e1-449a-9842-5fe86fe6b99e None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:46.751386 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f93f0-79e1-449a-9842-5fe86fe6b99e None admin] PATH_INFO: `/v3/domains` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:46.752020 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80f93f0-79e1-449a-9842-5fe86fe6b99e None admin] RBAC: Adding query filter params (name=Default) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:46.752323 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80f93f0-79e1-449a-9842-5fe86fe6b99e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:46.753803 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80f93f0-79e1-449a-9842-5fe86fe6b99e None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:46.772565 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 379/758] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Oct 1 20:33:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:47.349692 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea4959e-0ecf-4b56-946e-9f1d0ec6d008 None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:47.349977 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea4959e-0ecf-4b56-946e-9f1d0ec6d008 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:47.350255 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea4959e-0ecf-4b56-946e-9f1d0ec6d008 None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:47.351616 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 380/759] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:33:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:33:47.357452 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da13be5-1ef0-4c6c-a48b-53b3db4e8638 None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:47.357911 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da13be5-1ef0-4c6c-a48b-53b3db4e8638 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:47.358014 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da13be5-1ef0-4c6c-a48b-53b3db4e8638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:47.371648 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:47.377378 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-6da13be5-1ef0-4c6c-a48b-53b3db4e8638 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:33:47.378723 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-6da13be5-1ef0-4c6c-a48b-53b3db4e8638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:33:47.442760 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 380/760] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:33:47 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 01 20:33:47.773508 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea4959e-0ecf-4b56-946e-9f1d0ec6d008 None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:47.880602 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea4959e-0ecf-4b56-946e-9f1d0ec6d008 None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:47.913624 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0386ee-c82d-4c51-ad2b-33164a59e21f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:47.914216 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0386ee-c82d-4c51-ad2b-33164a59e21f None admin] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:47.914489 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0386ee-c82d-4c51-ad2b-33164a59e21f None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:47.914753 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0386ee-c82d-4c51-ad2b-33164a59e21f None admin] PATH_INFO: `/v3/services` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:47.915393 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0386ee-c82d-4c51-ad2b-33164a59e21f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:47.916892 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0386ee-c82d-4c51-ad2b-33164a59e21f None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:47.931185 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 381/761] 10.222.0.23 () {60 vars in 1141 bytes} [Sat Oct 1 20:33:47 2022] POST /identity/v3/services => generated 269 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 20:33:48.270374 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b1ddf-c880-406e-bb79-dcf8d945c1b4 None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:48.270656 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b1ddf-c880-406e-bb79-dcf8d945c1b4 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:48.270929 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b1ddf-c880-406e-bb79-dcf8d945c1b4 None None] PATH_INFO: `/` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:48.272264 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 381/762] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:33:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:33:48.278287 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa47023-2767-43a7-9158-3c6746b31588 None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:48.278514 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa47023-2767-43a7-9158-3c6746b31588 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:48.278787 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa47023-2767-43a7-9158-3c6746b31588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:48.296810 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-daa47023-2767-43a7-9158-3c6746b31588 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:33:48.297994 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-daa47023-2767-43a7-9158-3c6746b31588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:33:48.338695 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:48.372352 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 382/763] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:33:48 2022] POST /identity/v3/auth/tokens => generated 1516 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 01 20:33:48.694148 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56b1ddf-c880-406e-bb79-dcf8d945c1b4 None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:48.793426 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56b1ddf-c880-406e-bb79-dcf8d945c1b4 None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:48.826544 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a268f0-7143-4d8b-8d01-0928f9716323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:48.827133 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a268f0-7143-4d8b-8d01-0928f9716323 None admin] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:48.827409 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a268f0-7143-4d8b-8d01-0928f9716323 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:48.827679 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a268f0-7143-4d8b-8d01-0928f9716323 None admin] PATH_INFO: `/v3/services` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:48.828312 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a268f0-7143-4d8b-8d01-0928f9716323 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:48.829718 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a268f0-7143-4d8b-8d01-0928f9716323 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:48.834695 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:48.846934 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 382/764] 10.222.0.23 () {60 vars in 1141 bytes} [Sat Oct 1 20:33:48 2022] POST /identity/v3/services => generated 251 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 20:33:50.385777 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5551e6-a642-4ea6-b006-d7a302266c0d None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:50.386326 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5551e6-a642-4ea6-b006-d7a302266c0d None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:50.386326 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5551e6-a642-4ea6-b006-d7a302266c0d None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:50.388655 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 383/765] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:33:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:33:50.394040 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8075e422-1b07-42e9-8104-52d467064bbe None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:50.394466 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8075e422-1b07-42e9-8104-52d467064bbe None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:50.394565 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8075e422-1b07-42e9-8104-52d467064bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:50.413402 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-8075e422-1b07-42e9-8104-52d467064bbe None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:33:50.414583 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-8075e422-1b07-42e9-8104-52d467064bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:33:50.487007 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 383/766] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:33:50 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 01 20:33:50.813347 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5551e6-a642-4ea6-b006-d7a302266c0d None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:50.915325 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5551e6-a642-4ea6-b006-d7a302266c0d None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:50.949337 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66d7b0c-bef1-4d71-b09f-7fdd73dfaffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:50.949938 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66d7b0c-bef1-4d71-b09f-7fdd73dfaffc None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:50.950210 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66d7b0c-bef1-4d71-b09f-7fdd73dfaffc None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:50.950473 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66d7b0c-bef1-4d71-b09f-7fdd73dfaffc None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:50.951040 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66d7b0c-bef1-4d71-b09f-7fdd73dfaffc None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:50.952423 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66d7b0c-bef1-4d71-b09f-7fdd73dfaffc None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:50.961045 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-e66d7b0c-bef1-4d71-b09f-7fdd73dfaffc None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 01 20:33:50.961045 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:50.961045 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 01 20:33:50.961045 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 01 20:33:50.961045 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 01 20:33:50.961045 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 01 20:33:50.961045 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 01 20:33:50.961045 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 01 20:33:50.961045 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 01 20:33:50.961045 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:33:50.961045 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 01 20:33:50.961045 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:33:50.961045 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:50.961045 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:50.961045 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:50.961045 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:50.962833 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:50.962833 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:50.962833 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:50.962833 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:50.962833 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:50.962833 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:50.962833 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:50.962833 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 01 20:33:50.962833 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 01 20:33:50.962833 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 01 20:33:50.962833 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 01 20:33:50.962833 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:50.962833 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:50.962833 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:50.962833 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:50.962833 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:50.962833 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:50.965207 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:50.965207 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:50.965207 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:50.965207 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:50.965207 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:50.965207 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:50.965207 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:50.965207 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:50.965207 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:50.965207 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:50.965207 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 01 20:33:50.965207 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 01 20:33:50.965207 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 01 20:33:50.965207 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:33:50.965207 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 384/767] 10.222.0.23 () {56 vars in 1132 bytes} [Sat Oct 1 20:33:50 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:50.968755 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8075e422-1b07-42e9-8104-52d467064bbe None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:51.072781 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8075e422-1b07-42e9-8104-52d467064bbe None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:51.095821 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:51.107403 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f311de-4b1a-4071-9578-7e867da69902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:51.108001 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f311de-4b1a-4071-9578-7e867da69902 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:51.108276 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f311de-4b1a-4071-9578-7e867da69902 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:51.108576 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f311de-4b1a-4071-9578-7e867da69902 None admin] PATH_INFO: `/v3/services` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:51.109197 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f311de-4b1a-4071-9578-7e867da69902 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:51.109493 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f311de-4b1a-4071-9578-7e867da69902 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:51.110857 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f311de-4b1a-4071-9578-7e867da69902 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:51.115440 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 384/768] 10.222.0.23 () {56 vars in 1126 bytes} [Sat Oct 1 20:33:50 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:51.121461 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66d7b0c-bef1-4d71-b09f-7fdd73dfaffc None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:51.155660 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:51.221653 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66d7b0c-bef1-4d71-b09f-7fdd73dfaffc None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:51.253883 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811dbfc-ccd3-46fb-8d13-9594e12d3c69 None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:51.254093 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb92d97-d3bf-4ac1-9397-ffdb8286b919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:51.254218 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811dbfc-ccd3-46fb-8d13-9594e12d3c69 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:51.254417 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811dbfc-ccd3-46fb-8d13-9594e12d3c69 None None] PATH_INFO: `/` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:51.254566 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb92d97-d3bf-4ac1-9397-ffdb8286b919 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:51.254842 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb92d97-d3bf-4ac1-9397-ffdb8286b919 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:51.255114 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb92d97-d3bf-4ac1-9397-ffdb8286b919 None admin] PATH_INFO: `/v3/services` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:51.255723 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 385/769] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:33:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 01 20:33:51.255868 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb92d97-d3bf-4ac1-9397-ffdb8286b919 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:51.256027 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb92d97-d3bf-4ac1-9397-ffdb8286b919 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:51.257412 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb92d97-d3bf-4ac1-9397-ffdb8286b919 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:51.260599 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac465e-c701-48a9-a094-21caaa9a5b6b None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:51.260872 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac465e-c701-48a9-a094-21caaa9a5b6b None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:51.261136 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac465e-c701-48a9-a094-21caaa9a5b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:51.263024 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 385/770] 10.222.0.23 () {56 vars in 1126 bytes} [Sat Oct 1 20:33:51 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 20:33:51.269060 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb92d97-d3bf-4ac1-9397-ffdb8286b919 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:51.283031 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-b2ac465e-c701-48a9-a094-21caaa9a5b6b None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:33:51.284207 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-b2ac465e-c701-48a9-a094-21caaa9a5b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:33:51.350963 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 386/771] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:33:51 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 01 20:33:51.367563 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:51.372414 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb92d97-d3bf-4ac1-9397-ffdb8286b919 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:51.407301 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b07f9e-28c2-40ff-a734-6c02c9e433ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:51.407912 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b07f9e-28c2-40ff-a734-6c02c9e433ba None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:51.408163 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b07f9e-28c2-40ff-a734-6c02c9e433ba None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:51.408435 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b07f9e-28c2-40ff-a734-6c02c9e433ba None admin] PATH_INFO: `/v3/endpoints` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:51.409183 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b07f9e-28c2-40ff-a734-6c02c9e433ba None admin] RBAC: Adding query filter params (interface=public, service_id=945d7a932ca8472489a559d7ced6b1a0, region_id=RegionOne) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:51.409493 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b07f9e-28c2-40ff-a734-6c02c9e433ba None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:51.410858 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b07f9e-28c2-40ff-a734-6c02c9e433ba None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:51.415843 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 386/772] 10.222.0.23 () {56 vars in 1251 bytes} [Sat Oct 1 20:33:51 2022] GET /identity/v3/endpoints?service_id=945d7a932ca8472489a559d7ced6b1a0&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 20:33:51.422314 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ac465e-c701-48a9-a094-21caaa9a5b6b None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:51.519490 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ac465e-c701-48a9-a094-21caaa9a5b6b None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:51.535666 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:51.553284 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d43f42-82cf-4c9c-89f7-8a118ef72ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:51.553884 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d43f42-82cf-4c9c-89f7-8a118ef72ad4 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:51.554162 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d43f42-82cf-4c9c-89f7-8a118ef72ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:51.554432 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d43f42-82cf-4c9c-89f7-8a118ef72ad4 None admin] PATH_INFO: `/v3/services` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:51.555023 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d43f42-82cf-4c9c-89f7-8a118ef72ad4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:51.556399 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d43f42-82cf-4c9c-89f7-8a118ef72ad4 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:51.564662 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 387/773] 10.222.0.23 () {56 vars in 1087 bytes} [Sat Oct 1 20:33:51 2022] GET /identity/v3/services => generated 1498 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 20:33:51.671474 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b07f9e-28c2-40ff-a734-6c02c9e433ba None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:51.790578 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b07f9e-28c2-40ff-a734-6c02c9e433ba None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:51.824304 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850f0db2-9a83-4fdf-a910-efc811a17dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:51.824979 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850f0db2-9a83-4fdf-a910-efc811a17dba None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:51.825253 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850f0db2-9a83-4fdf-a910-efc811a17dba None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:51.825517 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850f0db2-9a83-4fdf-a910-efc811a17dba None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:51.826079 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850f0db2-9a83-4fdf-a910-efc811a17dba None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:51.827504 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850f0db2-9a83-4fdf-a910-efc811a17dba None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:51.835974 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-850f0db2-9a83-4fdf-a910-efc811a17dba None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 01 20:33:51.835974 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:51.835974 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 01 20:33:51.835974 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 01 20:33:51.835974 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 01 20:33:51.835974 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 01 20:33:51.835974 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 01 20:33:51.835974 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 01 20:33:51.835974 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 01 20:33:51.835974 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:33:51.835974 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 01 20:33:51.835974 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:33:51.835974 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:51.835974 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:51.835974 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:51.835974 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:51.835974 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:51.837070 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:51.837070 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:51.837070 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:51.837070 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:51.837070 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:51.837070 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:51.837070 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 01 20:33:51.837070 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 01 20:33:51.837070 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 01 20:33:51.837070 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 01 20:33:51.837070 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:51.837070 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:51.837070 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:51.837070 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:51.837070 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:51.837070 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:51.838452 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:51.838452 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:51.838452 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:51.838452 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:51.838452 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:51.838452 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:51.838452 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:51.838452 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:51.838452 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:51.838452 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:51.838452 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 01 20:33:51.838452 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 01 20:33:51.838452 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 01 20:33:51.838452 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:33:51.838452 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 387/774] 10.222.0.23 () {56 vars in 1114 bytes} [Sat Oct 1 20:33:51 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:51.843334 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d43f42-82cf-4c9c-89f7-8a118ef72ad4 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:51.943123 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d43f42-82cf-4c9c-89f7-8a118ef72ad4 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:51.975559 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85edff5-dd37-4000-8c8a-d6a4046a9941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:51.976165 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85edff5-dd37-4000-8c8a-d6a4046a9941 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:51.976441 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85edff5-dd37-4000-8c8a-d6a4046a9941 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:51.976739 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85edff5-dd37-4000-8c8a-d6a4046a9941 None admin] PATH_INFO: `/v3/services` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:51.977360 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85edff5-dd37-4000-8c8a-d6a4046a9941 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:51.977659 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85edff5-dd37-4000-8c8a-d6a4046a9941 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:51.979033 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85edff5-dd37-4000-8c8a-d6a4046a9941 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:51.984115 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 388/775] 10.222.0.23 () {56 vars in 1114 bytes} [Sat Oct 1 20:33:51 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:51.989909 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850f0db2-9a83-4fdf-a910-efc811a17dba None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:52.018033 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:52.092506 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850f0db2-9a83-4fdf-a910-efc811a17dba None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:52.125737 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae794c2b-e47c-4ca7-abcc-2eb5bb3f3011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:52.126306 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae794c2b-e47c-4ca7-abcc-2eb5bb3f3011 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:52.126577 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae794c2b-e47c-4ca7-abcc-2eb5bb3f3011 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:52.126843 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae794c2b-e47c-4ca7-abcc-2eb5bb3f3011 None admin] PATH_INFO: `/v3/services` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:52.127456 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae794c2b-e47c-4ca7-abcc-2eb5bb3f3011 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:52.127751 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae794c2b-e47c-4ca7-abcc-2eb5bb3f3011 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:52.129138 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae794c2b-e47c-4ca7-abcc-2eb5bb3f3011 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:52.133707 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 388/776] 10.222.0.23 () {56 vars in 1114 bytes} [Sat Oct 1 20:33:51 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 20:33:52.140146 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85edff5-dd37-4000-8c8a-d6a4046a9941 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:52.188338 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:52.242385 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85edff5-dd37-4000-8c8a-d6a4046a9941 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:52.276255 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d87f95-b122-4965-86c8-fbb04d5e649b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:52.276880 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d87f95-b122-4965-86c8-fbb04d5e649b None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:52.277286 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d87f95-b122-4965-86c8-fbb04d5e649b None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:52.277554 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d87f95-b122-4965-86c8-fbb04d5e649b None admin] PATH_INFO: `/v3/endpoints` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:52.278233 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d87f95-b122-4965-86c8-fbb04d5e649b None admin] RBAC: Adding query filter params (interface=public, service_id=a9d69c282c6549dc8e2fbdda6696c03d, region_id=RegionOne) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:52.278534 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d87f95-b122-4965-86c8-fbb04d5e649b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:52.279885 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d87f95-b122-4965-86c8-fbb04d5e649b None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:52.285022 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 389/777] 10.222.0.23 () {56 vars in 1251 bytes} [Sat Oct 1 20:33:52 2022] GET /identity/v3/endpoints?service_id=a9d69c282c6549dc8e2fbdda6696c03d&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:52.290810 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae794c2b-e47c-4ca7-abcc-2eb5bb3f3011 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:52.389115 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:52.398855 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae794c2b-e47c-4ca7-abcc-2eb5bb3f3011 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:52.430950 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99294f70-00d1-4368-a088-1cf12f4db1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:52.431573 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99294f70-00d1-4368-a088-1cf12f4db1c2 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:52.431793 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99294f70-00d1-4368-a088-1cf12f4db1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:52.432055 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99294f70-00d1-4368-a088-1cf12f4db1c2 None admin] PATH_INFO: `/v3/services` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:52.432671 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99294f70-00d1-4368-a088-1cf12f4db1c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:52.434519 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99294f70-00d1-4368-a088-1cf12f4db1c2 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:52.440282 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 389/778] 10.222.0.23 () {56 vars in 1087 bytes} [Sat Oct 1 20:33:52 2022] GET /identity/v3/services => generated 1498 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 20:33:53.997055 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb468dc-7b21-4d8d-8ca9-2d2b89c6e680 None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:54.000814 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb468dc-7b21-4d8d-8ca9-2d2b89c6e680 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:54.000814 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb468dc-7b21-4d8d-8ca9-2d2b89c6e680 None None] PATH_INFO: `/` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:54.000814 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 390/779] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:33:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:33:54.006983 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85857d-da5f-4df9-bba8-2b12ef645852 None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:54.007456 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85857d-da5f-4df9-bba8-2b12ef645852 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:54.007548 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85857d-da5f-4df9-bba8-2b12ef645852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:54.028475 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-2e85857d-da5f-4df9-bba8-2b12ef645852 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:33:54.029692 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-2e85857d-da5f-4df9-bba8-2b12ef645852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:33:54.111364 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 390/780] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:33:54 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 01 20:33:54.488069 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb468dc-7b21-4d8d-8ca9-2d2b89c6e680 None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:54.611389 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb468dc-7b21-4d8d-8ca9-2d2b89c6e680 None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:54.621899 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:54.651794 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb76db2f-cda0-44a9-a55e-ba84f8acb80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:54.653032 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76db2f-cda0-44a9-a55e-ba84f8acb80b None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:54.653457 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76db2f-cda0-44a9-a55e-ba84f8acb80b None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:54.653814 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76db2f-cda0-44a9-a55e-ba84f8acb80b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:54.654394 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb76db2f-cda0-44a9-a55e-ba84f8acb80b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:54.655780 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb76db2f-cda0-44a9-a55e-ba84f8acb80b None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:54.667570 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application [None req-bb76db2f-cda0-44a9-a55e-ba84f8acb80b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 01 20:33:54.667570 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:54.667570 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 01 20:33:54.667570 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 01 20:33:54.667570 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 01 20:33:54.667570 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 01 20:33:54.667570 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 01 20:33:54.667570 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 01 20:33:54.667570 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 01 20:33:54.667570 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:33:54.667570 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 01 20:33:54.667570 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:33:54.667570 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:54.667570 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:54.667570 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:54.667570 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:54.671916 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:54.671916 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:54.671916 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:54.671916 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:54.671916 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:54.671916 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:54.671916 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:54.671916 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 01 20:33:54.671916 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 01 20:33:54.671916 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 01 20:33:54.671916 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 01 20:33:54.671916 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:54.671916 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:54.671916 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:54.671916 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:54.671916 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:54.671916 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:54.674093 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:54.674093 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:54.674093 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:54.674093 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:54.674093 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:54.674093 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:54.674093 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:54.674093 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:54.674093 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:54.674093 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:54.674093 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 01 20:33:54.674093 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 01 20:33:54.674093 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 01 20:33:54.674093 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:33:54.674093 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 391/781] 10.222.0.23 () {56 vars in 1132 bytes} [Sat Oct 1 20:33:54 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:54.675340 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e85857d-da5f-4df9-bba8-2b12ef645852 None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:54.768472 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:54.786552 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e85857d-da5f-4df9-bba8-2b12ef645852 None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:54.819776 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e6c019-6b47-49e0-8ce1-6dc636f8fcc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:54.820382 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6c019-6b47-49e0-8ce1-6dc636f8fcc9 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:54.820699 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6c019-6b47-49e0-8ce1-6dc636f8fcc9 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:54.820973 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6c019-6b47-49e0-8ce1-6dc636f8fcc9 None admin] PATH_INFO: `/v3/services` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:54.821601 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e6c019-6b47-49e0-8ce1-6dc636f8fcc9 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:54.821902 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e6c019-6b47-49e0-8ce1-6dc636f8fcc9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:54.823264 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e6c019-6b47-49e0-8ce1-6dc636f8fcc9 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:54.828476 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 391/782] 10.222.0.23 () {56 vars in 1126 bytes} [Sat Oct 1 20:33:54 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:54.834203 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb76db2f-cda0-44a9-a55e-ba84f8acb80b None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:54.936158 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb76db2f-cda0-44a9-a55e-ba84f8acb80b None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:54.968215 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d2dc0-e982-45ec-8f44-f96a5bed04a2 None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:54.968589 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d2dc0-e982-45ec-8f44-f96a5bed04a2 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:54.968875 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d2dc0-e982-45ec-8f44-f96a5bed04a2 None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:54.970204 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 392/783] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:33:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 01 20:33:54.970685 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21192dda-6b00-4d52-9470-3b619e68e949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:54.971289 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21192dda-6b00-4d52-9470-3b619e68e949 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:54.971565 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21192dda-6b00-4d52-9470-3b619e68e949 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:54.971833 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21192dda-6b00-4d52-9470-3b619e68e949 None admin] PATH_INFO: `/v3/services` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:54.972457 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21192dda-6b00-4d52-9470-3b619e68e949 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:54.972786 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21192dda-6b00-4d52-9470-3b619e68e949 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:54.974160 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21192dda-6b00-4d52-9470-3b619e68e949 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:54.975411 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90143cf-50e2-414d-b59c-531c122331d7 None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:54.975690 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90143cf-50e2-414d-b59c-531c122331d7 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:54.975961 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90143cf-50e2-414d-b59c-531c122331d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:54.982036 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 392/784] 10.222.0.23 () {56 vars in 1126 bytes} [Sat Oct 1 20:33:54 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:54.985014 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21192dda-6b00-4d52-9470-3b619e68e949 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:54.994197 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-b90143cf-50e2-414d-b59c-531c122331d7 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:33:54.995380 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-b90143cf-50e2-414d-b59c-531c122331d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:33:55.020600 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:55.061657 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 393/785] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:33:54 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 01 20:33:55.088810 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21192dda-6b00-4d52-9470-3b619e68e949 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:55.121809 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3e7859-552b-43bb-b271-443721d025a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:55.122397 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3e7859-552b-43bb-b271-443721d025a6 None admin] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:55.122673 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3e7859-552b-43bb-b271-443721d025a6 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:55.122938 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3e7859-552b-43bb-b271-443721d025a6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:55.123584 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3e7859-552b-43bb-b271-443721d025a6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:55.125038 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3e7859-552b-43bb-b271-443721d025a6 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:55.144169 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 393/786] 10.222.0.23 () {60 vars in 1144 bytes} [Sat Oct 1 20:33:54 2022] POST /identity/v3/endpoints => generated 347 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 01 20:33:55.392410 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90143cf-50e2-414d-b59c-531c122331d7 None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:55.472366 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:55.498805 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90143cf-50e2-414d-b59c-531c122331d7 None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:55.539419 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86d5a10-69f2-4563-a0f5-10902a60bd49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:55.540048 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d5a10-69f2-4563-a0f5-10902a60bd49 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:55.540326 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d5a10-69f2-4563-a0f5-10902a60bd49 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:55.540627 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d5a10-69f2-4563-a0f5-10902a60bd49 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:55.541209 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86d5a10-69f2-4563-a0f5-10902a60bd49 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:55.542602 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86d5a10-69f2-4563-a0f5-10902a60bd49 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:55.551508 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-f86d5a10-69f2-4563-a0f5-10902a60bd49 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 01 20:33:55.551508 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:55.551508 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 01 20:33:55.551508 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 01 20:33:55.551508 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 01 20:33:55.551508 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 01 20:33:55.551508 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 01 20:33:55.551508 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 01 20:33:55.551508 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 01 20:33:55.551508 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:33:55.551508 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 01 20:33:55.551508 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:33:55.551508 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:55.551508 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:55.551508 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:55.551508 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:55.551508 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:55.552722 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:55.552722 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:55.552722 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:55.552722 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:55.552722 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:55.552722 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:55.552722 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 01 20:33:55.552722 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 01 20:33:55.552722 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 01 20:33:55.552722 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 01 20:33:55.552722 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:55.552722 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:55.552722 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:55.552722 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:55.552722 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:55.552722 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:55.553596 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:55.553596 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:55.553596 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:55.553596 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:55.553596 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:55.553596 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:55.553596 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:55.553596 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:55.553596 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:55.553596 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:55.553596 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 01 20:33:55.553596 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 01 20:33:55.553596 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 01 20:33:55.553596 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:33:55.553596 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 394/787] 10.222.0.23 () {56 vars in 1114 bytes} [Sat Oct 1 20:33:55 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:55.558654 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3e7859-552b-43bb-b271-443721d025a6 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:55.649671 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:55.660372 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3e7859-552b-43bb-b271-443721d025a6 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:55.694192 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032f9f73-c487-4790-8895-aa360928fdf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:55.694794 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f9f73-c487-4790-8895-aa360928fdf2 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:55.695072 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f9f73-c487-4790-8895-aa360928fdf2 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:55.695341 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f9f73-c487-4790-8895-aa360928fdf2 None admin] PATH_INFO: `/v3/services` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:55.695958 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032f9f73-c487-4790-8895-aa360928fdf2 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:55.696291 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032f9f73-c487-4790-8895-aa360928fdf2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:55.697712 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032f9f73-c487-4790-8895-aa360928fdf2 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:55.703283 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 394/788] 10.222.0.23 () {56 vars in 1114 bytes} [Sat Oct 1 20:33:55 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:33:55.708892 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86d5a10-69f2-4563-a0f5-10902a60bd49 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:55.809918 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86d5a10-69f2-4563-a0f5-10902a60bd49 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:55.843476 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8d5e67-c8e1-426e-aa2c-80c48b823ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:55.844096 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d5e67-c8e1-426e-aa2c-80c48b823ac9 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:55.844356 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d5e67-c8e1-426e-aa2c-80c48b823ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:55.844639 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d5e67-c8e1-426e-aa2c-80c48b823ac9 None admin] PATH_INFO: `/v3/services` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:55.845266 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8d5e67-c8e1-426e-aa2c-80c48b823ac9 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:55.845570 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8d5e67-c8e1-426e-aa2c-80c48b823ac9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:55.846936 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8d5e67-c8e1-426e-aa2c-80c48b823ac9 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:55.851683 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 395/789] 10.222.0.23 () {56 vars in 1114 bytes} [Sat Oct 1 20:33:55 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 20:33:55.858172 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032f9f73-c487-4790-8895-aa360928fdf2 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:55.956837 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032f9f73-c487-4790-8895-aa360928fdf2 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:55.990165 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da0d8ec-8eb1-44b2-98f7-4b291dc19f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:55.990785 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da0d8ec-8eb1-44b2-98f7-4b291dc19f19 None admin] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:55.991061 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da0d8ec-8eb1-44b2-98f7-4b291dc19f19 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:55.991330 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da0d8ec-8eb1-44b2-98f7-4b291dc19f19 None admin] PATH_INFO: `/v3/endpoints` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:55.991990 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da0d8ec-8eb1-44b2-98f7-4b291dc19f19 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:55.993389 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da0d8ec-8eb1-44b2-98f7-4b291dc19f19 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:56.024551 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 395/790] 10.222.0.23 () {60 vars in 1144 bytes} [Sat Oct 1 20:33:55 2022] POST /identity/v3/endpoints => generated 346 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 20:33:57.554793 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa0832-3e38-4ee4-86f7-ad08af7e4ec4 None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:57.555361 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa0832-3e38-4ee4-86f7-ad08af7e4ec4 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:57.555361 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa0832-3e38-4ee4-86f7-ad08af7e4ec4 None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:57.556863 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 396/791] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:33:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:33:57.562760 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6496d7cf-5758-4c85-a508-f0b040d8bc12 None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:57.563161 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6496d7cf-5758-4c85-a508-f0b040d8bc12 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:57.563302 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6496d7cf-5758-4c85-a508-f0b040d8bc12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:57.582651 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-6496d7cf-5758-4c85-a508-f0b040d8bc12 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:33:57.583838 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-6496d7cf-5758-4c85-a508-f0b040d8bc12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:33:57.591387 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:57.655586 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 396/792] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:33:57 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 01 20:33:57.984187 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fa0832-3e38-4ee4-86f7-ad08af7e4ec4 None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:57.987090 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:58.091035 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fa0832-3e38-4ee4-86f7-ad08af7e4ec4 None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:58.125304 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c23ead-431e-43a6-8b9d-9a96a6e6d9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:58.125925 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c23ead-431e-43a6-8b9d-9a96a6e6d9f4 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:58.126201 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c23ead-431e-43a6-8b9d-9a96a6e6d9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:58.126474 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c23ead-431e-43a6-8b9d-9a96a6e6d9f4 None admin] PATH_INFO: `/v3/services/compute` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:58.127108 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c23ead-431e-43a6-8b9d-9a96a6e6d9f4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:58.128478 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c23ead-431e-43a6-8b9d-9a96a6e6d9f4 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:58.140659 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-e6c23ead-431e-43a6-8b9d-9a96a6e6d9f4 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 01 20:33:58.140659 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:58.140659 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 01 20:33:58.140659 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 01 20:33:58.140659 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 01 20:33:58.140659 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 01 20:33:58.140659 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 01 20:33:58.140659 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 01 20:33:58.140659 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 01 20:33:58.140659 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:33:58.140659 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 01 20:33:58.140659 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:33:58.140659 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:58.140659 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:58.140659 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:58.140659 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:58.140659 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:58.141879 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:58.141879 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:58.141879 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:58.141879 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:58.141879 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:58.141879 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:58.141879 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 01 20:33:58.141879 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 01 20:33:58.141879 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 01 20:33:58.141879 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 01 20:33:58.141879 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:58.141879 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:58.141879 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:58.141879 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:58.141879 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:58.141879 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:58.142885 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:58.142885 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:58.142885 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:58.142885 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:58.142885 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:58.142885 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:58.142885 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:58.142885 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:58.142885 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:58.142885 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:58.142885 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 01 20:33:58.142885 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 01 20:33:58.142885 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 01 20:33:58.142885 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:33:58.144681 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 397/793] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Oct 1 20:33:57 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:58.147867 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6496d7cf-5758-4c85-a508-f0b040d8bc12 None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:58.251872 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6496d7cf-5758-4c85-a508-f0b040d8bc12 None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:58.285332 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e26718-ef94-4f6b-9302-6ea979f30da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:58.286018 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e26718-ef94-4f6b-9302-6ea979f30da1 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:58.286316 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e26718-ef94-4f6b-9302-6ea979f30da1 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:58.286583 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e26718-ef94-4f6b-9302-6ea979f30da1 None admin] PATH_INFO: `/v3/services` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:58.287196 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e26718-ef94-4f6b-9302-6ea979f30da1 None admin] RBAC: Adding query filter params (name=compute) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:58.287492 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e26718-ef94-4f6b-9302-6ea979f30da1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:58.288911 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e26718-ef94-4f6b-9302-6ea979f30da1 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:58.293525 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 397/794] 10.222.0.23 () {56 vars in 1112 bytes} [Sat Oct 1 20:33:58 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 20:33:58.299210 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c23ead-431e-43a6-8b9d-9a96a6e6d9f4 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:58.363852 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:58.400029 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c23ead-431e-43a6-8b9d-9a96a6e6d9f4 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:58.433851 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ca5114-2951-4301-b9f9-95852806f9b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:58.434443 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca5114-2951-4301-b9f9-95852806f9b2 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:58.434717 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca5114-2951-4301-b9f9-95852806f9b2 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:58.434987 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca5114-2951-4301-b9f9-95852806f9b2 None admin] PATH_INFO: `/v3/services` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:58.435605 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ca5114-2951-4301-b9f9-95852806f9b2 None admin] RBAC: Adding query filter params (type=compute) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:58.435903 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ca5114-2951-4301-b9f9-95852806f9b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:58.437295 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ca5114-2951-4301-b9f9-95852806f9b2 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:58.441993 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 398/795] 10.222.0.23 () {56 vars in 1112 bytes} [Sat Oct 1 20:33:58 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 20:33:58.454508 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69d9ac-2581-4461-9873-29f28feb254a None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:58.454791 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69d9ac-2581-4461-9873-29f28feb254a None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:58.455066 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69d9ac-2581-4461-9873-29f28feb254a None None] PATH_INFO: `/` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:58.456428 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 398/796] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:33:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:33:58.462410 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686dfe23-26d4-4735-8ad2-ec1413c6f204 None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:58.462687 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686dfe23-26d4-4735-8ad2-ec1413c6f204 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:58.462957 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686dfe23-26d4-4735-8ad2-ec1413c6f204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:58.484463 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-686dfe23-26d4-4735-8ad2-ec1413c6f204 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:33:58.486693 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-686dfe23-26d4-4735-8ad2-ec1413c6f204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:33:58.560019 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 399/797] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:33:58 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 01 20:33:58.881339 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d69d9ac-2581-4461-9873-29f28feb254a None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:58.884128 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:58.984504 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d69d9ac-2581-4461-9873-29f28feb254a None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:59.016899 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2d6c26-1719-4e0c-b16b-876b80b0fde8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:59.017488 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d6c26-1719-4e0c-b16b-876b80b0fde8 None admin] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:59.017760 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d6c26-1719-4e0c-b16b-876b80b0fde8 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:59.018026 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d6c26-1719-4e0c-b16b-876b80b0fde8 None admin] PATH_INFO: `/v3/projects` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:59.018654 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2d6c26-1719-4e0c-b16b-876b80b0fde8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:59.020104 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2d6c26-1719-4e0c-b16b-876b80b0fde8 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:59.022674 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: WARNING keystone.server.flask.common [None req-7c2d6c26-1719-4e0c-b16b-876b80b0fde8 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 01 20:33:59.041567 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.sql.core [None req-7c2d6c26-1719-4e0c-b16b-876b80b0fde8 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 01 20:33:59.041567 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 01 20:33:59.041567 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [parameters: {'id': 'cef6f5e5de324399a34501033b5d0d11', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 01 20:33:59.041567 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=94756) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 01 20:33:59.058655 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application [None req-7c2d6c26-1719-4e0c-b16b-876b80b0fde8 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id cef6f5e5de324399a34501033b5d0d11.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id cef6f5e5de324399a34501033b5d0d11. Oct 01 20:33:59.058655 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:59.058655 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 01 20:33:59.058655 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 01 20:33:59.058655 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 01 20:33:59.058655 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 01 20:33:59.058655 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 01 20:33:59.058655 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application result = self._query(query) Oct 01 20:33:59.058655 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 01 20:33:59.058655 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application conn.query(q) Oct 01 20:33:59.058655 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 01 20:33:59.058655 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 01 20:33:59.058655 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 01 20:33:59.059666 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application result.read() Oct 01 20:33:59.059666 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 01 20:33:59.059666 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 01 20:33:59.059666 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 01 20:33:59.059666 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 01 20:33:59.059666 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 01 20:33:59.059666 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 01 20:33:59.059666 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 01 20:33:59.059666 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 01 20:33:59.059666 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 01 20:33:59.059666 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:33:59.059666 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 01 20:33:59.059666 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:33:59.059666 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:59.059666 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 01 20:33:59.059666 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 01 20:33:59.059666 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 01 20:33:59.059666 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 01 20:33:59.060795 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 01 20:33:59.060795 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application next(self.gen) Oct 01 20:33:59.060795 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 01 20:33:59.060795 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application yield resource Oct 01 20:33:59.060795 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 01 20:33:59.060795 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application next(self.gen) Oct 01 20:33:59.060795 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 01 20:33:59.060795 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application self.session.rollback() Oct 01 20:33:59.060795 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 01 20:33:59.060795 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application self.force_reraise() Oct 01 20:33:59.060795 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 01 20:33:59.060795 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application raise self.value Oct 01 20:33:59.060795 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 01 20:33:59.060795 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 01 20:33:59.060795 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 01 20:33:59.060795 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application session.commit() Oct 01 20:33:59.060795 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 01 20:33:59.061722 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 01 20:33:59.061722 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 01 20:33:59.061722 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application self._prepare_impl() Oct 01 20:33:59.061722 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 01 20:33:59.061722 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application self.session.flush() Oct 01 20:33:59.061722 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 01 20:33:59.061722 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application self._flush(objects) Oct 01 20:33:59.061722 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 01 20:33:59.061722 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 01 20:33:59.061722 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 01 20:33:59.061722 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application compat.raise_( Oct 01 20:33:59.061722 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 01 20:33:59.061722 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application raise exception Oct 01 20:33:59.061722 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 01 20:33:59.061722 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application flush_context.execute() Oct 01 20:33:59.061722 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 01 20:33:59.061722 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application rec.execute(self) Oct 01 20:33:59.062670 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 01 20:33:59.062670 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 01 20:33:59.062670 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 01 20:33:59.062670 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 01 20:33:59.062670 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 01 20:33:59.062670 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 01 20:33:59.062670 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 01 20:33:59.062670 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 01 20:33:59.062670 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 01 20:33:59.062670 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 01 20:33:59.062670 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 01 20:33:59.062670 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 01 20:33:59.062670 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 01 20:33:59.062670 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 01 20:33:59.062670 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 01 20:33:59.063485 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 01 20:33:59.063485 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 01 20:33:59.063485 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application raise exception Oct 01 20:33:59.063485 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 01 20:33:59.063485 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 01 20:33:59.063485 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 01 20:33:59.063485 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 01 20:33:59.063485 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 01 20:33:59.063485 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application result = self._query(query) Oct 01 20:33:59.063485 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 01 20:33:59.063485 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application conn.query(q) Oct 01 20:33:59.063485 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 01 20:33:59.063485 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 01 20:33:59.063485 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 01 20:33:59.063485 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application result.read() Oct 01 20:33:59.063485 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 01 20:33:59.063485 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 01 20:33:59.064402 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 01 20:33:59.064402 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 01 20:33:59.064402 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 01 20:33:59.064402 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 01 20:33:59.064402 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 01 20:33:59.064402 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 01 20:33:59.064402 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 01 20:33:59.064402 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 01 20:33:59.064402 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application [parameters: {'id': 'cef6f5e5de324399a34501033b5d0d11', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 01 20:33:59.064402 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 01 20:33:59.064402 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:33:59.064402 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 01 20:33:59.064402 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:33:59.064402 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:59.064402 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 01 20:33:59.066015 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 01 20:33:59.066015 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 01 20:33:59.066015 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 01 20:33:59.066015 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 01 20:33:59.066015 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:33:59.066015 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 01 20:33:59.066015 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:33:59.066015 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:59.066015 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:59.066015 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:59.066015 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:59.066015 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:59.066015 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:59.066015 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:59.066015 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:59.066015 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:59.066015 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:59.067444 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:59.067444 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 01 20:33:59.067444 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 01 20:33:59.067444 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:59.067444 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:59.067444 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 01 20:33:59.067444 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 01 20:33:59.067444 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id cef6f5e5de324399a34501033b5d0d11. Oct 01 20:33:59.067444 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:33:59.067444 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 399/798] 10.222.0.23 () {60 vars in 1140 bytes} [Sat Oct 1 20:33:58 2022] POST /identity/v3/projects => generated 262 bytes in 184 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:59.068259 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686dfe23-26d4-4735-8ad2-ec1413c6f204 None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:59.129551 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:59.172006 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686dfe23-26d4-4735-8ad2-ec1413c6f204 None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:59.206946 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc32bc68-f654-4ece-b5cb-3b96d102027e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:59.207572 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc32bc68-f654-4ece-b5cb-3b96d102027e None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:59.207851 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc32bc68-f654-4ece-b5cb-3b96d102027e None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:59.208122 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc32bc68-f654-4ece-b5cb-3b96d102027e None admin] PATH_INFO: `/v3/projects/service` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:59.214994 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc32bc68-f654-4ece-b5cb-3b96d102027e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:59.216653 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc32bc68-f654-4ece-b5cb-3b96d102027e None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:59.227992 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-cc32bc68-f654-4ece-b5cb-3b96d102027e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 20:33:59.227992 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:33:59.227992 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:33:59.227992 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:33:59.227992 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:33:59.227992 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:33:59.227992 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:33:59.227992 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:33:59.227992 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:33:59.227992 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:33:59.227992 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:33:59.227992 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:33:59.227992 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 01 20:33:59.227992 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 01 20:33:59.227992 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 01 20:33:59.229080 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 01 20:33:59.229080 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:33:59.229080 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:33:59.229080 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:33:59.229080 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:33:59.229080 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:33:59.229080 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:33:59.229080 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:33:59.229080 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:33:59.229080 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:33:59.229080 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:33:59.229080 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:33:59.229080 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:33:59.229080 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:33:59.229080 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:33:59.229080 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:33:59.229080 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:33:59.230554 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 01 20:33:59.230554 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 01 20:33:59.230554 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 01 20:33:59.230554 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 01 20:33:59.230554 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 01 20:33:59.230554 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 01 20:33:59.230554 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 20:33:59.230554 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:33:59.230554 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 400/799] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Oct 1 20:33:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:33:59.235326 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2d6c26-1719-4e0c-b16b-876b80b0fde8 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:33:59.300770 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:33:59.342881 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2d6c26-1719-4e0c-b16b-876b80b0fde8 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:33:59.376715 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ed44d6-10fe-40fa-95f3-8f998fb4dc31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:33:59.377313 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ed44d6-10fe-40fa-95f3-8f998fb4dc31 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:33:59.377592 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ed44d6-10fe-40fa-95f3-8f998fb4dc31 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:33:59.377867 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ed44d6-10fe-40fa-95f3-8f998fb4dc31 None admin] PATH_INFO: `/v3/projects` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:33:59.378528 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ed44d6-10fe-40fa-95f3-8f998fb4dc31 None admin] RBAC: Adding query filter params (name=service) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:33:59.378830 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ed44d6-10fe-40fa-95f3-8f998fb4dc31 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:33:59.380485 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ed44d6-10fe-40fa-95f3-8f998fb4dc31 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:33:59.399963 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 400/800] 10.222.0.23 () {56 vars in 1112 bytes} [Sat Oct 1 20:33:59 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:34:00.851703 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3499fbee-6d81-416c-a6a8-651e4e8ac545 None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:34:00.852243 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3499fbee-6d81-416c-a6a8-651e4e8ac545 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:34:00.852243 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3499fbee-6d81-416c-a6a8-651e4e8ac545 None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:34:00.853653 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 401/801] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:34:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:34:00.859757 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2675d0-b166-43f3-94ac-641d259bad95 None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:34:00.860179 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2675d0-b166-43f3-94ac-641d259bad95 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:34:00.860299 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2675d0-b166-43f3-94ac-641d259bad95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:34:00.880967 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-fd2675d0-b166-43f3-94ac-641d259bad95 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:34:00.882463 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-fd2675d0-b166-43f3-94ac-641d259bad95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:34:00.948133 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 401/802] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:34:00 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 01 20:34:01.272805 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3499fbee-6d81-416c-a6a8-651e4e8ac545 None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:34:01.371308 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3499fbee-6d81-416c-a6a8-651e4e8ac545 None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:34:01.394252 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:34:01.408979 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3eef9f-b6e9-4b25-8c47-2b51b2f21036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:34:01.409583 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3eef9f-b6e9-4b25-8c47-2b51b2f21036 None admin] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:34:01.409858 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3eef9f-b6e9-4b25-8c47-2b51b2f21036 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:34:01.410124 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3eef9f-b6e9-4b25-8c47-2b51b2f21036 None admin] PATH_INFO: `/v3/services` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:34:01.410811 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3eef9f-b6e9-4b25-8c47-2b51b2f21036 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:34:01.412167 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3eef9f-b6e9-4b25-8c47-2b51b2f21036 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:34:01.426045 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 402/803] 10.222.0.23 () {60 vars in 1141 bytes} [Sat Oct 1 20:34:01 2022] POST /identity/v3/services => generated 242 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 20:34:01.911157 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a2a7d-de9e-4f99-aba1-1b0d74716d1d None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:34:01.911699 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a2a7d-de9e-4f99-aba1-1b0d74716d1d None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:34:01.911699 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a2a7d-de9e-4f99-aba1-1b0d74716d1d None None] PATH_INFO: `/` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:34:01.913100 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 402/804] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:34:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:34:01.919097 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b0e7b3-9c49-4a3c-b9f2-cc669043db0d None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:34:01.919512 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b0e7b3-9c49-4a3c-b9f2-cc669043db0d None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:34:01.919796 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b0e7b3-9c49-4a3c-b9f2-cc669043db0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:34:01.938913 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-c0b0e7b3-9c49-4a3c-b9f2-cc669043db0d None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:34:01.940113 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-c0b0e7b3-9c49-4a3c-b9f2-cc669043db0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:34:02.011279 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 403/805] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:34:01 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 01 20:34:02.350267 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55a2a7d-de9e-4f99-aba1-1b0d74716d1d None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:34:02.399958 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:34:02.451928 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55a2a7d-de9e-4f99-aba1-1b0d74716d1d None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:34:02.485287 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c2c69-c61c-4a15-b441-c9b15d3f915a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:34:02.485885 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c2c69-c61c-4a15-b441-c9b15d3f915a None admin] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:34:02.486162 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c2c69-c61c-4a15-b441-c9b15d3f915a None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:34:02.486429 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c2c69-c61c-4a15-b441-c9b15d3f915a None admin] PATH_INFO: `/v3/users` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:34:02.487053 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16c2c69-c61c-4a15-b441-c9b15d3f915a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:34:02.488477 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16c2c69-c61c-4a15-b441-c9b15d3f915a None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:34:02.504238 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.sql.core [None req-b16c2c69-c61c-4a15-b441-c9b15d3f915a None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 01 20:34:02.504238 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 01 20:34:02.504238 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [parameters: {'user_id': '9a2d4028427d4e87ad74f1655ad88735', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 01 20:34:02.504238 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=94756) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 01 20:34:02.511467 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application [None req-b16c2c69-c61c-4a15-b441-c9b15d3f915a None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 01 20:34:02.511467 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:34:02.511467 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 01 20:34:02.511467 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 01 20:34:02.511467 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 01 20:34:02.511467 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 01 20:34:02.511467 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 01 20:34:02.511467 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application result = self._query(query) Oct 01 20:34:02.511467 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 01 20:34:02.511467 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application conn.query(q) Oct 01 20:34:02.511467 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 01 20:34:02.511467 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 01 20:34:02.511467 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 01 20:34:02.511467 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application result.read() Oct 01 20:34:02.511467 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 01 20:34:02.512834 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 01 20:34:02.512834 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 01 20:34:02.512834 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 01 20:34:02.512834 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 01 20:34:02.512834 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 01 20:34:02.512834 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 01 20:34:02.512834 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 01 20:34:02.512834 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 01 20:34:02.512834 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:34:02.512834 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 01 20:34:02.512834 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:34:02.512834 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:34:02.512834 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 01 20:34:02.512834 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 01 20:34:02.512834 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 01 20:34:02.512834 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 01 20:34:02.512834 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 01 20:34:02.512834 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application next(self.gen) Oct 01 20:34:02.513820 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 01 20:34:02.513820 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application yield resource Oct 01 20:34:02.513820 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 01 20:34:02.513820 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application next(self.gen) Oct 01 20:34:02.513820 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 01 20:34:02.513820 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application self.session.rollback() Oct 01 20:34:02.513820 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 01 20:34:02.513820 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application self.force_reraise() Oct 01 20:34:02.513820 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 01 20:34:02.513820 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application raise self.value Oct 01 20:34:02.513820 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 01 20:34:02.513820 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 01 20:34:02.513820 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 01 20:34:02.513820 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application session.commit() Oct 01 20:34:02.513820 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 01 20:34:02.513820 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 01 20:34:02.513820 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 01 20:34:02.514743 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application self._prepare_impl() Oct 01 20:34:02.514743 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 01 20:34:02.514743 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application self.session.flush() Oct 01 20:34:02.514743 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 01 20:34:02.514743 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application self._flush(objects) Oct 01 20:34:02.514743 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 01 20:34:02.514743 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 01 20:34:02.514743 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 01 20:34:02.514743 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application compat.raise_( Oct 01 20:34:02.514743 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 01 20:34:02.514743 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application raise exception Oct 01 20:34:02.514743 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 01 20:34:02.514743 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application flush_context.execute() Oct 01 20:34:02.514743 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 01 20:34:02.514743 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application rec.execute(self) Oct 01 20:34:02.514743 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 01 20:34:02.514743 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 01 20:34:02.515629 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 01 20:34:02.515629 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 01 20:34:02.515629 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 01 20:34:02.515629 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 01 20:34:02.515629 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 01 20:34:02.515629 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 01 20:34:02.515629 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 01 20:34:02.515629 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 01 20:34:02.515629 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 01 20:34:02.515629 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 01 20:34:02.515629 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 01 20:34:02.515629 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 01 20:34:02.515629 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 01 20:34:02.515629 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 01 20:34:02.515629 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 01 20:34:02.515629 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application raise exception Oct 01 20:34:02.516482 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 01 20:34:02.516482 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 01 20:34:02.516482 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 01 20:34:02.516482 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 01 20:34:02.516482 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 01 20:34:02.516482 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application result = self._query(query) Oct 01 20:34:02.516482 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 01 20:34:02.516482 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application conn.query(q) Oct 01 20:34:02.516482 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 01 20:34:02.516482 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 01 20:34:02.516482 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 01 20:34:02.516482 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application result.read() Oct 01 20:34:02.516482 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 01 20:34:02.516482 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 01 20:34:02.516482 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 01 20:34:02.516482 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 01 20:34:02.517820 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 01 20:34:02.517820 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 01 20:34:02.517820 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 01 20:34:02.517820 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 01 20:34:02.517820 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 01 20:34:02.517820 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 01 20:34:02.517820 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application [parameters: {'user_id': '9a2d4028427d4e87ad74f1655ad88735', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 01 20:34:02.517820 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 01 20:34:02.517820 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:34:02.517820 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 01 20:34:02.517820 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:34:02.517820 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:34:02.517820 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:34:02.517820 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:34:02.517820 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:34:02.518883 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:34:02.518883 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:34:02.518883 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:34:02.518883 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:34:02.518883 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:34:02.518883 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:34:02.518883 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:34:02.518883 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 01 20:34:02.518883 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 01 20:34:02.518883 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:34:02.518883 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:34:02.518883 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 01 20:34:02.518883 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 20:34:02.518883 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 01 20:34:02.518883 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 20:34:02.518883 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 01 20:34:02.518883 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 01 20:34:02.520003 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 01 20:34:02.520003 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 01 20:34:02.520003 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 01 20:34:02.520003 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 01 20:34:02.520003 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 01 20:34:02.520003 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:34:02.520003 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 403/806] 10.222.0.23 () {60 vars in 1131 bytes} [Sat Oct 1 20:34:02 2022] POST /identity/v3/users => generated 160 bytes in 163 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:34:02.520478 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b0e7b3-9c49-4a3c-b9f2-cc669043db0d None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:34:02.615703 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b0e7b3-9c49-4a3c-b9f2-cc669043db0d None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:34:02.623033 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:34:02.650182 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1efb7c-533d-49d4-8c4c-2d004890b97d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:34:02.650799 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1efb7c-533d-49d4-8c4c-2d004890b97d None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:34:02.651071 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1efb7c-533d-49d4-8c4c-2d004890b97d None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:34:02.651337 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1efb7c-533d-49d4-8c4c-2d004890b97d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:34:02.658656 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1efb7c-533d-49d4-8c4c-2d004890b97d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:34:02.660079 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1efb7c-533d-49d4-8c4c-2d004890b97d None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:34:02.671379 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-3c1efb7c-533d-49d4-8c4c-2d004890b97d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 01 20:34:02.671379 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:34:02.671379 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:34:02.671379 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:34:02.671379 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:34:02.671379 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:34:02.671379 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:34:02.671379 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:34:02.671379 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:34:02.671379 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:34:02.671379 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:34:02.671379 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:34:02.671379 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 01 20:34:02.671379 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 01 20:34:02.671379 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 01 20:34:02.671379 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 01 20:34:02.672612 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:34:02.672612 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:34:02.672612 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 01 20:34:02.672612 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 20:34:02.672612 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 01 20:34:02.672612 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 20:34:02.672612 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:34:02.672612 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:34:02.672612 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:34:02.672612 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:34:02.672612 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:34:02.672612 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:34:02.672612 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:34:02.672612 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:34:02.672612 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:34:02.672612 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:34:02.672612 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:34:02.672612 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:34:02.673556 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:34:02.673556 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:34:02.673556 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 01 20:34:02.673556 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 01 20:34:02.673556 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 01 20:34:02.673556 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 01 20:34:02.673556 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 01 20:34:02.673556 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 01 20:34:02.673556 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 01 20:34:02.673556 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:34:02.673556 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 404/807] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Oct 1 20:34:02 2022] GET /identity/v3/users/cinder => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:34:02.678441 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c2c69-c61c-4a15-b441-c9b15d3f915a None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:34:02.778393 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c2c69-c61c-4a15-b441-c9b15d3f915a None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:34:02.789018 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:34:02.814694 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591c2347-978c-45c5-9759-46c40c688495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:34:02.815343 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c2347-978c-45c5-9759-46c40c688495 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:34:02.815620 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c2347-978c-45c5-9759-46c40c688495 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:34:02.815887 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c2347-978c-45c5-9759-46c40c688495 None admin] PATH_INFO: `/v3/users` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:34:02.816975 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591c2347-978c-45c5-9759-46c40c688495 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:34:02.818582 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591c2347-978c-45c5-9759-46c40c688495 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:34:02.818787 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591c2347-978c-45c5-9759-46c40c688495 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:34:02.856748 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 404/808] 10.222.0.23 () {56 vars in 1101 bytes} [Sat Oct 1 20:34:02 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:34:03.832894 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f50b3d3-5886-4033-bb75-09f0b1caed94 None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:34:03.833457 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f50b3d3-5886-4033-bb75-09f0b1caed94 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:34:03.833457 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f50b3d3-5886-4033-bb75-09f0b1caed94 None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:34:03.834751 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 405/809] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:34:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:34:03.840675 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e832aa8d-47e4-48ca-ba4a-020c22ac6894 None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:34:03.841091 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e832aa8d-47e4-48ca-ba4a-020c22ac6894 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:34:03.841243 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e832aa8d-47e4-48ca-ba4a-020c22ac6894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:34:03.859562 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-e832aa8d-47e4-48ca-ba4a-020c22ac6894 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:34:03.861108 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-e832aa8d-47e4-48ca-ba4a-020c22ac6894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:34:03.925229 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 405/810] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:34:03 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 01 20:34:04.241277 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f50b3d3-5886-4033-bb75-09f0b1caed94 None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:34:04.339516 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f50b3d3-5886-4033-bb75-09f0b1caed94 None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:34:04.371864 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8295c861-8424-41b5-ba7f-f3c3d7f03d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:34:04.372467 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295c861-8424-41b5-ba7f-f3c3d7f03d78 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:34:04.372764 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295c861-8424-41b5-ba7f-f3c3d7f03d78 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:34:04.373030 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295c861-8424-41b5-ba7f-f3c3d7f03d78 None admin] PATH_INFO: `/v3/services/compute` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:34:04.373595 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8295c861-8424-41b5-ba7f-f3c3d7f03d78 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:34:04.374942 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8295c861-8424-41b5-ba7f-f3c3d7f03d78 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:34:04.383317 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-8295c861-8424-41b5-ba7f-f3c3d7f03d78 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 01 20:34:04.383317 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:34:04.383317 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 01 20:34:04.383317 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 01 20:34:04.383317 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 01 20:34:04.383317 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 01 20:34:04.383317 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 01 20:34:04.383317 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 01 20:34:04.383317 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 01 20:34:04.383317 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:34:04.383317 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 01 20:34:04.383317 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:34:04.383317 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:34:04.383317 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:34:04.383317 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:34:04.383317 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:34:04.383317 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:34:04.384446 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:34:04.384446 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:34:04.384446 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:34:04.384446 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:34:04.384446 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:34:04.384446 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:34:04.384446 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 01 20:34:04.384446 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 01 20:34:04.384446 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 01 20:34:04.384446 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 01 20:34:04.384446 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:34:04.384446 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:34:04.384446 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:34:04.384446 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:34:04.384446 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:34:04.384446 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:34:04.385335 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:34:04.385335 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:34:04.385335 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:34:04.385335 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:34:04.385335 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:34:04.385335 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:34:04.385335 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:34:04.385335 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:34:04.385335 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:34:04.385335 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:34:04.385335 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 01 20:34:04.385335 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 01 20:34:04.385335 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 01 20:34:04.385335 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:34:04.385335 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 406/811] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Oct 1 20:34:04 2022] GET /identity/v3/services/compute => generated 88 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:34:04.390478 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e832aa8d-47e4-48ca-ba4a-020c22ac6894 None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:34:04.482394 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:34:04.486613 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e832aa8d-47e4-48ca-ba4a-020c22ac6894 None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:34:04.520940 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d422d2fb-f260-40dd-ac17-6eb2ae4cd597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:34:04.521555 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d422d2fb-f260-40dd-ac17-6eb2ae4cd597 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:34:04.521832 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d422d2fb-f260-40dd-ac17-6eb2ae4cd597 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:34:04.522102 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d422d2fb-f260-40dd-ac17-6eb2ae4cd597 None admin] PATH_INFO: `/v3/services` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:34:04.522720 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d422d2fb-f260-40dd-ac17-6eb2ae4cd597 None admin] RBAC: Adding query filter params (name=compute) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:34:04.523020 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d422d2fb-f260-40dd-ac17-6eb2ae4cd597 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:34:04.524384 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d422d2fb-f260-40dd-ac17-6eb2ae4cd597 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:34:04.529841 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 406/812] 10.222.0.23 () {56 vars in 1112 bytes} [Sat Oct 1 20:34:04 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:34:04.535415 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8295c861-8424-41b5-ba7f-f3c3d7f03d78 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:34:04.565012 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:34:04.632778 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8295c861-8424-41b5-ba7f-f3c3d7f03d78 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:34:04.665044 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45681b68-9c4e-464d-a176-afabd5e97974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:34:04.665626 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45681b68-9c4e-464d-a176-afabd5e97974 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:34:04.665905 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45681b68-9c4e-464d-a176-afabd5e97974 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:34:04.666178 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45681b68-9c4e-464d-a176-afabd5e97974 None admin] PATH_INFO: `/v3/services` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:34:04.666795 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45681b68-9c4e-464d-a176-afabd5e97974 None admin] RBAC: Adding query filter params (type=compute) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:34:04.667614 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45681b68-9c4e-464d-a176-afabd5e97974 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:34:04.668999 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45681b68-9c4e-464d-a176-afabd5e97974 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:34:04.673565 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 407/813] 10.222.0.23 () {56 vars in 1112 bytes} [Sat Oct 1 20:34:04 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:34:04.679383 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d422d2fb-f260-40dd-ac17-6eb2ae4cd597 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:34:04.775442 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d422d2fb-f260-40dd-ac17-6eb2ae4cd597 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:34:04.808510 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65058b4a-1700-47f4-9689-4e315ea17096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:34:04.809120 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65058b4a-1700-47f4-9689-4e315ea17096 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:34:04.809391 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65058b4a-1700-47f4-9689-4e315ea17096 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:34:04.809655 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65058b4a-1700-47f4-9689-4e315ea17096 None admin] PATH_INFO: `/v3/endpoints` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:34:04.810329 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65058b4a-1700-47f4-9689-4e315ea17096 None admin] RBAC: Adding query filter params (interface=public, service_id=e640c5e9cd1d4c15bb29d7cdd57dbfaa, region_id=RegionOne) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:34:04.810625 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65058b4a-1700-47f4-9689-4e315ea17096 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:34:04.811969 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65058b4a-1700-47f4-9689-4e315ea17096 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:34:04.817032 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 407/814] 10.222.0.23 () {56 vars in 1251 bytes} [Sat Oct 1 20:34:04 2022] GET /identity/v3/endpoints?service_id=e640c5e9cd1d4c15bb29d7cdd57dbfaa&interface=public®ion_id=RegionOne => generated 194 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:34:04.822736 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45681b68-9c4e-464d-a176-afabd5e97974 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:34:04.913904 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:34:04.921790 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45681b68-9c4e-464d-a176-afabd5e97974 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:34:04.953915 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73072765-0d5b-4472-9b2d-bf1dc75ff3f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:34:04.954509 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73072765-0d5b-4472-9b2d-bf1dc75ff3f7 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:34:04.954782 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73072765-0d5b-4472-9b2d-bf1dc75ff3f7 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:34:04.955050 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73072765-0d5b-4472-9b2d-bf1dc75ff3f7 None admin] PATH_INFO: `/v3/services` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:34:04.955638 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73072765-0d5b-4472-9b2d-bf1dc75ff3f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:34:04.957026 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73072765-0d5b-4472-9b2d-bf1dc75ff3f7 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:34:04.962902 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 408/815] 10.222.0.23 () {56 vars in 1087 bytes} [Sat Oct 1 20:34:04 2022] GET /identity/v3/services => generated 1728 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 20:34:07.384853 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772ba023-24ee-4331-b613-4eef341090b4 None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:34:07.385403 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772ba023-24ee-4331-b613-4eef341090b4 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:34:07.385403 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772ba023-24ee-4331-b613-4eef341090b4 None None] PATH_INFO: `/` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:34:07.386733 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 408/816] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:34:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:34:07.391910 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc14d6b6-cdc7-4c60-a7f4-46e3b0398854 None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:34:07.392313 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc14d6b6-cdc7-4c60-a7f4-46e3b0398854 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:34:07.392464 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc14d6b6-cdc7-4c60-a7f4-46e3b0398854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:34:07.411888 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-bc14d6b6-cdc7-4c60-a7f4-46e3b0398854 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:34:07.413119 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-bc14d6b6-cdc7-4c60-a7f4-46e3b0398854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:34:07.479195 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 409/817] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:34:07 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 01 20:34:07.813699 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772ba023-24ee-4331-b613-4eef341090b4 None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:34:07.840875 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:34:07.912775 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772ba023-24ee-4331-b613-4eef341090b4 None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:34:07.945493 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd8ece8-e04c-4671-a858-4f41f3e0c9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:34:07.946104 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd8ece8-e04c-4671-a858-4f41f3e0c9c1 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:34:07.946380 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd8ece8-e04c-4671-a858-4f41f3e0c9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:34:07.946651 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd8ece8-e04c-4671-a858-4f41f3e0c9c1 None admin] PATH_INFO: `/v3/services/compute` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:34:07.947222 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd8ece8-e04c-4671-a858-4f41f3e0c9c1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:34:07.949181 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd8ece8-e04c-4671-a858-4f41f3e0c9c1 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:34:07.957611 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application [None req-1fd8ece8-e04c-4671-a858-4f41f3e0c9c1 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 01 20:34:07.957611 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:34:07.957611 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 01 20:34:07.957611 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 01 20:34:07.957611 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 01 20:34:07.957611 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 01 20:34:07.957611 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 01 20:34:07.957611 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 01 20:34:07.957611 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 01 20:34:07.957611 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:34:07.957611 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 01 20:34:07.957611 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:34:07.957611 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:34:07.957611 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:34:07.957611 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:34:07.957611 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:34:07.957611 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:34:07.958770 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:34:07.958770 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:34:07.958770 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:34:07.958770 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:34:07.958770 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:34:07.958770 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:34:07.958770 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 01 20:34:07.958770 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 01 20:34:07.958770 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 01 20:34:07.958770 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 01 20:34:07.958770 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:34:07.958770 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:34:07.958770 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:34:07.958770 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:34:07.958770 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:34:07.958770 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:34:07.959635 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:34:07.959635 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application with Lock( Oct 01 20:34:07.959635 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:34:07.959635 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:34:07.959635 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:34:07.959635 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:34:07.959635 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:34:07.959635 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:34:07.959635 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:34:07.959635 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:34:07.959635 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 01 20:34:07.959635 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 01 20:34:07.959635 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 01 20:34:07.959635 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:34:07.959635 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 409/818] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Oct 1 20:34:07 2022] GET /identity/v3/services/compute => generated 88 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:34:07.964998 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc14d6b6-cdc7-4c60-a7f4-46e3b0398854 None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:34:08.047738 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:34:08.059893 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc14d6b6-cdc7-4c60-a7f4-46e3b0398854 None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:34:08.093005 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491b9871-523d-4eb4-ad4a-13f77919def6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:34:08.093538 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b9871-523d-4eb4-ad4a-13f77919def6 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:34:08.093809 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b9871-523d-4eb4-ad4a-13f77919def6 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:34:08.094075 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b9871-523d-4eb4-ad4a-13f77919def6 None admin] PATH_INFO: `/v3/services` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:34:08.094691 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491b9871-523d-4eb4-ad4a-13f77919def6 None admin] RBAC: Adding query filter params (name=compute) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:34:08.094987 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491b9871-523d-4eb4-ad4a-13f77919def6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:34:08.096331 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491b9871-523d-4eb4-ad4a-13f77919def6 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:34:08.100872 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 410/819] 10.222.0.23 () {56 vars in 1112 bytes} [Sat Oct 1 20:34:07 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:34:08.106942 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd8ece8-e04c-4671-a858-4f41f3e0c9c1 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:34:08.195862 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:34:08.206370 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd8ece8-e04c-4671-a858-4f41f3e0c9c1 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:34:08.238739 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a779f9b-5645-440f-89ba-c33c461f658b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:34:08.239328 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a779f9b-5645-440f-89ba-c33c461f658b None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:34:08.239606 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a779f9b-5645-440f-89ba-c33c461f658b None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:34:08.239878 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a779f9b-5645-440f-89ba-c33c461f658b None admin] PATH_INFO: `/v3/services` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:34:08.240495 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a779f9b-5645-440f-89ba-c33c461f658b None admin] RBAC: Adding query filter params (type=compute) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:34:08.240825 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a779f9b-5645-440f-89ba-c33c461f658b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:34:08.242184 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a779f9b-5645-440f-89ba-c33c461f658b None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:34:08.247357 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 410/820] 10.222.0.23 () {56 vars in 1112 bytes} [Sat Oct 1 20:34:08 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:34:08.253094 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491b9871-523d-4eb4-ad4a-13f77919def6 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:34:08.349975 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491b9871-523d-4eb4-ad4a-13f77919def6 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:34:08.382691 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e393ca-546b-401e-bd7d-ba020bce72ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:34:08.383273 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e393ca-546b-401e-bd7d-ba020bce72ad None admin] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:34:08.383548 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e393ca-546b-401e-bd7d-ba020bce72ad None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:34:08.383815 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e393ca-546b-401e-bd7d-ba020bce72ad None admin] PATH_INFO: `/v3/endpoints` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:34:08.384473 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e393ca-546b-401e-bd7d-ba020bce72ad None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:34:08.385903 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e393ca-546b-401e-bd7d-ba020bce72ad None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:34:08.404490 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 411/821] 10.222.0.23 () {60 vars in 1144 bytes} [Sat Oct 1 20:34:08 2022] POST /identity/v3/endpoints => generated 334 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 20:34:18.245128 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=23 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:34:18.400534 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=95,keystone:INSERT=1 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:35:11.650709 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c603342-f122-43d6-8554-2325cf266e52 None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:11.651312 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c603342-f122-43d6-8554-2325cf266e52 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:11.651312 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c603342-f122-43d6-8554-2325cf266e52 None None] PATH_INFO: `/` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:11.652892 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 411/822] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:35:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:35:11.658801 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23047a08-3e33-4bb5-94c7-c8044b598989 None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:11.659320 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23047a08-3e33-4bb5-94c7-c8044b598989 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:11.659434 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23047a08-3e33-4bb5-94c7-c8044b598989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:11.678924 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-23047a08-3e33-4bb5-94c7-c8044b598989 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:35:11.680714 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-23047a08-3e33-4bb5-94c7-c8044b598989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:35:11.775633 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 412/823] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:35:11 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 01 20:35:12.113310 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c603342-f122-43d6-8554-2325cf266e52 None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:35:12.248207 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c603342-f122-43d6-8554-2325cf266e52 None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:35:12.298403 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d045a26-a4b0-41b8-9fca-f7ec37d0ffc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:35:12.299052 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d045a26-a4b0-41b8-9fca-f7ec37d0ffc4 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:12.299383 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d045a26-a4b0-41b8-9fca-f7ec37d0ffc4 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:12.299662 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d045a26-a4b0-41b8-9fca-f7ec37d0ffc4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:12.315734 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d045a26-a4b0-41b8-9fca-f7ec37d0ffc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:35:12.317414 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d045a26-a4b0-41b8-9fca-f7ec37d0ffc4 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:35:12.339021 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application [None req-5d045a26-a4b0-41b8-9fca-f7ec37d0ffc4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:35:12.339021 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:35:12.339021 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:35:12.339021 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:35:12.339021 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:35:12.339021 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:35:12.339021 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:35:12.339021 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:35:12.339021 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:35:12.339021 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:35:12.339021 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:35:12.339021 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:35:12.339021 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 20:35:12.339021 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 20:35:12.339021 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 20:35:12.339021 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 20:35:12.340387 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:35:12.340387 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:35:12.340387 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:35:12.340387 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:35:12.340387 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:35:12.340387 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:35:12.340387 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:35:12.340387 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application with Lock( Oct 01 20:35:12.340387 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:35:12.340387 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:35:12.340387 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:35:12.340387 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:35:12.340387 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:35:12.340387 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:35:12.340387 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:35:12.340387 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:35:12.340387 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 20:35:12.341579 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 20:35:12.341579 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:35:12.341579 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:35:12.341579 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 412/824] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Oct 1 20:35:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 01 20:35:12.349275 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23047a08-3e33-4bb5-94c7-c8044b598989 None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:35:12.489631 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23047a08-3e33-4bb5-94c7-c8044b598989 None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:35:12.522563 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:35:12.533851 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cff3ada-d1e1-460a-95da-fbfe6d73b27b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:35:12.534521 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff3ada-d1e1-460a-95da-fbfe6d73b27b None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:12.534909 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff3ada-d1e1-460a-95da-fbfe6d73b27b None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:12.535227 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff3ada-d1e1-460a-95da-fbfe6d73b27b None admin] PATH_INFO: `/v3/domains` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:12.535988 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cff3ada-d1e1-460a-95da-fbfe6d73b27b None admin] RBAC: Adding query filter params (name=Default) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:35:12.536295 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cff3ada-d1e1-460a-95da-fbfe6d73b27b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:35:12.537989 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cff3ada-d1e1-460a-95da-fbfe6d73b27b None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:35:12.552963 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 413/825] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Oct 1 20:35:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:35:12.559036 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d045a26-a4b0-41b8-9fca-f7ec37d0ffc4 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:35:12.626356 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:35:12.687957 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d045a26-a4b0-41b8-9fca-f7ec37d0ffc4 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:35:12.731383 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98df0c9-692d-43f0-af03-47c92485876c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:35:12.732030 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98df0c9-692d-43f0-af03-47c92485876c None admin] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:12.732328 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98df0c9-692d-43f0-af03-47c92485876c None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:12.732596 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98df0c9-692d-43f0-af03-47c92485876c None admin] PATH_INFO: `/v3/users` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:12.733289 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98df0c9-692d-43f0-af03-47c92485876c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:35:12.735054 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98df0c9-692d-43f0-af03-47c92485876c None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:35:12.766251 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 413/826] 10.222.0.23 () {60 vars in 1132 bytes} [Sat Oct 1 20:35:12 2022] POST /identity/v3/users => generated 251 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 01 20:35:15.582731 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927421e7-a435-4c2a-a585-273c8659e52c None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:15.583298 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927421e7-a435-4c2a-a585-273c8659e52c None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:15.583298 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927421e7-a435-4c2a-a585-273c8659e52c None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:15.584606 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 414/827] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:35:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:35:15.590563 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7afe57e-67ed-4e5c-93d2-03c35a99caa9 None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:15.590999 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7afe57e-67ed-4e5c-93d2-03c35a99caa9 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:15.591102 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7afe57e-67ed-4e5c-93d2-03c35a99caa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:15.612195 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-b7afe57e-67ed-4e5c-93d2-03c35a99caa9 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:35:15.613576 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-b7afe57e-67ed-4e5c-93d2-03c35a99caa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:35:15.693097 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 414/828] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:35:15 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 01 20:35:16.025212 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927421e7-a435-4c2a-a585-273c8659e52c None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:35:16.139410 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927421e7-a435-4c2a-a585-273c8659e52c None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:35:16.178441 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177725af-9618-4264-b67f-10ab622e8b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:35:16.179527 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177725af-9618-4264-b67f-10ab622e8b18 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:16.180019 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177725af-9618-4264-b67f-10ab622e8b18 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:16.180498 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177725af-9618-4264-b67f-10ab622e8b18 None admin] PATH_INFO: `/v3/roles/service` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:16.194222 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177725af-9618-4264-b67f-10ab622e8b18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 20:35:16.199388 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-177725af-9618-4264-b67f-10ab622e8b18 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 01 20:35:16.199388 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:35:16.199388 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:35:16.199388 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:35:16.199388 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:35:16.199388 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:35:16.199388 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:35:16.199388 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:35:16.199388 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:35:16.199388 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:35:16.199388 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:35:16.199388 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:35:16.199388 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 20:35:16.199388 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 20:35:16.199388 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 20:35:16.199388 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 20:35:16.200484 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 20:35:16.200484 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 20:35:16.200484 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 20:35:16.200484 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 20:35:16.200484 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:35:16.200484 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:35:16.200484 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:35:16.200484 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:35:16.200484 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:35:16.200484 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:35:16.200484 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:35:16.200484 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:35:16.200484 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:35:16.200484 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:35:16.200484 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:35:16.200484 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:35:16.201398 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:35:16.201398 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:35:16.201398 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:35:16.201398 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:35:16.201398 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 20:35:16.201398 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 20:35:16.201398 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 20:35:16.201398 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 20:35:16.201398 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 20:35:16.201398 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 20:35:16.201398 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 01 20:35:16.201398 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:35:16.201398 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 415/829] 10.222.0.23 () {56 vars in 1102 bytes} [Sat Oct 1 20:35:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:35:16.209276 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7afe57e-67ed-4e5c-93d2-03c35a99caa9 None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:35:16.253934 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:35:16.317469 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7afe57e-67ed-4e5c-93d2-03c35a99caa9 None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:35:16.355266 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1c74ad-999a-49bc-95f5-85e69373f36b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:35:16.356714 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c74ad-999a-49bc-95f5-85e69373f36b None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:16.357072 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c74ad-999a-49bc-95f5-85e69373f36b None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:16.357351 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c74ad-999a-49bc-95f5-85e69373f36b None admin] PATH_INFO: `/v3/roles` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:16.358016 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1c74ad-999a-49bc-95f5-85e69373f36b None admin] RBAC: Adding query filter params (name=service) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:35:16.358322 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1c74ad-999a-49bc-95f5-85e69373f36b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:35:16.359696 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1c74ad-999a-49bc-95f5-85e69373f36b None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:35:16.368944 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 415/830] 10.222.0.23 () {56 vars in 1103 bytes} [Sat Oct 1 20:35:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:35:16.374638 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177725af-9618-4264-b67f-10ab622e8b18 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:35:16.439183 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:35:16.509147 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177725af-9618-4264-b67f-10ab622e8b18 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:35:16.547810 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c5eaae-b3a7-4c87-a84b-ca07b58f8807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:35:16.552343 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c5eaae-b3a7-4c87-a84b-ca07b58f8807 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:16.552343 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c5eaae-b3a7-4c87-a84b-ca07b58f8807 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:16.552343 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c5eaae-b3a7-4c87-a84b-ca07b58f8807 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:16.564437 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c5eaae-b3a7-4c87-a84b-ca07b58f8807 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:35:16.566314 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c5eaae-b3a7-4c87-a84b-ca07b58f8807 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:35:16.581963 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-f2c5eaae-b3a7-4c87-a84b-ca07b58f8807 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:35:16.581963 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:35:16.581963 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:35:16.581963 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:35:16.581963 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:35:16.581963 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:35:16.581963 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:35:16.581963 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:35:16.581963 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:35:16.581963 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:35:16.581963 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:35:16.581963 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:35:16.581963 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 20:35:16.581963 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 20:35:16.581963 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 20:35:16.581963 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 20:35:16.583435 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:35:16.583435 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:35:16.583435 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:35:16.583435 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:35:16.583435 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:35:16.583435 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:35:16.583435 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:35:16.583435 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:35:16.583435 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:35:16.583435 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:35:16.583435 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:35:16.583435 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:35:16.583435 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:35:16.583435 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:35:16.583435 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:35:16.583435 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:35:16.583435 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 20:35:16.584345 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 20:35:16.584345 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:35:16.584345 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:35:16.584345 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 416/831] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Oct 1 20:35:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:35:16.589001 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1c74ad-999a-49bc-95f5-85e69373f36b None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:35:16.698782 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:35:16.702461 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1c74ad-999a-49bc-95f5-85e69373f36b None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:35:16.740803 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14554897-1d4b-4a81-b195-7f15174fb660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:35:16.741546 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14554897-1d4b-4a81-b195-7f15174fb660 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:16.741969 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14554897-1d4b-4a81-b195-7f15174fb660 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:16.742328 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14554897-1d4b-4a81-b195-7f15174fb660 None admin] PATH_INFO: `/v3/domains` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:16.743027 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14554897-1d4b-4a81-b195-7f15174fb660 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:35:16.743331 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14554897-1d4b-4a81-b195-7f15174fb660 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:35:16.744815 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14554897-1d4b-4a81-b195-7f15174fb660 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:35:16.758442 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 416/832] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Oct 1 20:35:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:35:16.764621 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c5eaae-b3a7-4c87-a84b-ca07b58f8807 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:35:16.880882 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:35:16.887002 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c5eaae-b3a7-4c87-a84b-ca07b58f8807 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:35:16.921950 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235a8dd3-307f-458e-8949-e4a75d616c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:35:16.922626 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a8dd3-307f-458e-8949-e4a75d616c1f None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:16.922924 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a8dd3-307f-458e-8949-e4a75d616c1f None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:16.923222 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a8dd3-307f-458e-8949-e4a75d616c1f None admin] PATH_INFO: `/v3/users/placement` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:16.931945 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235a8dd3-307f-458e-8949-e4a75d616c1f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:35:16.933490 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235a8dd3-307f-458e-8949-e4a75d616c1f None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:35:16.945677 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-235a8dd3-307f-458e-8949-e4a75d616c1f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 01 20:35:16.945677 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:35:16.945677 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:35:16.945677 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:35:16.945677 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:35:16.945677 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:35:16.945677 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:35:16.945677 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:35:16.945677 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:35:16.945677 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:35:16.945677 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:35:16.945677 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:35:16.945677 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 01 20:35:16.945677 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 01 20:35:16.945677 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 01 20:35:16.945677 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 01 20:35:16.946703 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:35:16.946703 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:35:16.946703 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 01 20:35:16.946703 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 20:35:16.946703 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 01 20:35:16.946703 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 20:35:16.946703 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:35:16.946703 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:35:16.946703 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:35:16.946703 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:35:16.946703 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:35:16.946703 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:35:16.946703 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:35:16.946703 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:35:16.946703 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:35:16.946703 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:35:16.946703 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:35:16.946703 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:35:16.947675 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:35:16.947675 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:35:16.947675 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 01 20:35:16.947675 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 01 20:35:16.947675 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 01 20:35:16.947675 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 01 20:35:16.947675 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 01 20:35:16.947675 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 01 20:35:16.947675 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 01 20:35:16.947675 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:35:16.947675 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 417/833] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Oct 1 20:35:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:35:16.952694 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14554897-1d4b-4a81-b195-7f15174fb660 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:35:17.062162 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14554897-1d4b-4a81-b195-7f15174fb660 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:35:17.099717 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4b5064-c95a-43fe-869a-e67bfc29ab96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:35:17.100405 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4b5064-c95a-43fe-869a-e67bfc29ab96 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:17.100818 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4b5064-c95a-43fe-869a-e67bfc29ab96 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:17.101132 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4b5064-c95a-43fe-869a-e67bfc29ab96 None admin] PATH_INFO: `/v3/users` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:17.101853 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4b5064-c95a-43fe-869a-e67bfc29ab96 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:35:17.102161 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4b5064-c95a-43fe-869a-e67bfc29ab96 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:35:17.103877 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4b5064-c95a-43fe-869a-e67bfc29ab96 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:35:17.123001 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 417/834] 10.222.0.23 () {56 vars in 1143 bytes} [Sat Oct 1 20:35:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:35:17.128846 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235a8dd3-307f-458e-8949-e4a75d616c1f None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:35:17.238571 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235a8dd3-307f-458e-8949-e4a75d616c1f None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:35:17.277576 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f66585d-0ebe-4512-803f-be225c808f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:35:17.278267 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f66585d-0ebe-4512-803f-be225c808f7f None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:17.278540 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f66585d-0ebe-4512-803f-be225c808f7f None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:17.278808 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f66585d-0ebe-4512-803f-be225c808f7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:17.306421 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:35:17.351669 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f66585d-0ebe-4512-803f-be225c808f7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:35:17.353153 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f66585d-0ebe-4512-803f-be225c808f7f None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:35:17.462513 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 418/835] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Oct 1 20:35:17 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 01 20:35:17.468402 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4b5064-c95a-43fe-869a-e67bfc29ab96 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:35:17.488339 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:35:17.582201 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4b5064-c95a-43fe-869a-e67bfc29ab96 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:35:17.620817 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b556df3e-9382-4799-9c70-829ecb5794fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:35:17.621447 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b556df3e-9382-4799-9c70-829ecb5794fc None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:17.621726 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b556df3e-9382-4799-9c70-829ecb5794fc None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:17.621993 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b556df3e-9382-4799-9c70-829ecb5794fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:17.633155 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b556df3e-9382-4799-9c70-829ecb5794fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:35:17.634823 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b556df3e-9382-4799-9c70-829ecb5794fc None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:35:17.650771 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application [None req-b556df3e-9382-4799-9c70-829ecb5794fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:35:17.650771 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:35:17.650771 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:35:17.650771 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:35:17.650771 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:35:17.650771 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:35:17.650771 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:35:17.650771 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:35:17.650771 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:35:17.650771 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:35:17.650771 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:35:17.650771 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:35:17.650771 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 20:35:17.650771 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 20:35:17.650771 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 20:35:17.650771 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 20:35:17.657317 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:35:17.657317 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:35:17.657317 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:35:17.657317 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:35:17.657317 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:35:17.657317 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:35:17.657317 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:35:17.657317 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application with Lock( Oct 01 20:35:17.657317 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:35:17.657317 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:35:17.657317 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:35:17.657317 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:35:17.657317 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:35:17.657317 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:35:17.657317 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:35:17.657317 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:35:17.657317 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 20:35:17.658481 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 20:35:17.658481 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:35:17.658481 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:35:17.658481 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 418/836] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Oct 1 20:35:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:35:17.658785 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f66585d-0ebe-4512-803f-be225c808f7f None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:35:17.727209 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:35:17.775384 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f66585d-0ebe-4512-803f-be225c808f7f None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:35:17.812213 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8959c6a1-b02c-4c0a-93e1-ad4ac6d27eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:35:17.812840 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8959c6a1-b02c-4c0a-93e1-ad4ac6d27eb9 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:17.813116 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8959c6a1-b02c-4c0a-93e1-ad4ac6d27eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:17.813383 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8959c6a1-b02c-4c0a-93e1-ad4ac6d27eb9 None admin] PATH_INFO: `/v3/domains` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:17.814009 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8959c6a1-b02c-4c0a-93e1-ad4ac6d27eb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:35:17.814307 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8959c6a1-b02c-4c0a-93e1-ad4ac6d27eb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:35:17.816029 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8959c6a1-b02c-4c0a-93e1-ad4ac6d27eb9 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:35:17.828370 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 419/837] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Oct 1 20:35:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:35:17.834040 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b556df3e-9382-4799-9c70-829ecb5794fc None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:35:17.915188 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:35:17.951746 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b556df3e-9382-4799-9c70-829ecb5794fc None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:35:17.993418 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0715c0cf-60ce-49ad-86b4-c1ab1eaff068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:35:17.993970 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0715c0cf-60ce-49ad-86b4-c1ab1eaff068 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:17.994250 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0715c0cf-60ce-49ad-86b4-c1ab1eaff068 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:17.994586 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0715c0cf-60ce-49ad-86b4-c1ab1eaff068 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:18.001810 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0715c0cf-60ce-49ad-86b4-c1ab1eaff068 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:35:18.003418 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0715c0cf-60ce-49ad-86b4-c1ab1eaff068 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:35:18.015460 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application [None req-0715c0cf-60ce-49ad-86b4-c1ab1eaff068 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 20:35:18.015460 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:35:18.015460 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:35:18.015460 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:35:18.015460 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:35:18.015460 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:35:18.015460 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:35:18.015460 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:35:18.015460 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:35:18.015460 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:35:18.015460 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:35:18.015460 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:35:18.015460 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 01 20:35:18.015460 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 01 20:35:18.015460 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 01 20:35:18.016682 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 01 20:35:18.016682 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:35:18.016682 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:35:18.016682 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:35:18.016682 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:35:18.016682 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:35:18.016682 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:35:18.016682 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:35:18.016682 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application with Lock( Oct 01 20:35:18.016682 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:35:18.016682 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:35:18.016682 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:35:18.016682 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:35:18.016682 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:35:18.016682 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:35:18.016682 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:35:18.016682 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:35:18.017574 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 01 20:35:18.017574 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 01 20:35:18.017574 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 01 20:35:18.017574 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 01 20:35:18.017574 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 01 20:35:18.017574 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 01 20:35:18.017574 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 20:35:18.017574 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:35:18.017574 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 419/838] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Oct 1 20:35:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:35:18.022647 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8959c6a1-b02c-4c0a-93e1-ad4ac6d27eb9 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:35:18.132239 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8959c6a1-b02c-4c0a-93e1-ad4ac6d27eb9 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:35:18.150305 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:35:18.170242 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9a53ae-57eb-4a24-b991-0b3f1b970e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:35:18.170852 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a53ae-57eb-4a24-b991-0b3f1b970e8d None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:18.171128 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a53ae-57eb-4a24-b991-0b3f1b970e8d None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:18.171398 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a53ae-57eb-4a24-b991-0b3f1b970e8d None admin] PATH_INFO: `/v3/projects` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:18.172387 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9a53ae-57eb-4a24-b991-0b3f1b970e8d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:35:18.172387 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9a53ae-57eb-4a24-b991-0b3f1b970e8d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:35:18.174815 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9a53ae-57eb-4a24-b991-0b3f1b970e8d None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:35:18.189923 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 420/839] 10.222.0.23 () {56 vars in 1148 bytes} [Sat Oct 1 20:35:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:35:18.196988 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0715c0cf-60ce-49ad-86b4-c1ab1eaff068 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:35:18.313983 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0715c0cf-60ce-49ad-86b4-c1ab1eaff068 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:35:18.347624 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:35:18.355150 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8997f454-ff4b-4104-aef5-2431cdb824b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:35:18.355755 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8997f454-ff4b-4104-aef5-2431cdb824b7 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:18.356033 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8997f454-ff4b-4104-aef5-2431cdb824b7 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:18.356348 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8997f454-ff4b-4104-aef5-2431cdb824b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:18.357055 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8997f454-ff4b-4104-aef5-2431cdb824b7 None admin] RBAC: Adding query filter params (role.id=da1d78af3e8a425e8ce1130b079f8fce, scope.project.id=8f242c4eeaa04ed19dcdc8ba95b86cfb, user.id=645c8f9d14a743c2b1103eec2a07c4e8) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:35:18.357397 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8997f454-ff4b-4104-aef5-2431cdb824b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:35:18.359040 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8997f454-ff4b-4104-aef5-2431cdb824b7 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:35:18.364473 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 420/840] 10.222.0.23 () {56 vars in 1374 bytes} [Sat Oct 1 20:35:18 2022] GET /identity/v3/role_assignments?user.id=645c8f9d14a743c2b1103eec2a07c4e8&scope.project.id=8f242c4eeaa04ed19dcdc8ba95b86cfb&role.id=da1d78af3e8a425e8ce1130b079f8fce => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:35:20.817625 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb2c5f-1e89-4c21-96aa-b51a20f1c5ca None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:20.818162 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb2c5f-1e89-4c21-96aa-b51a20f1c5ca None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:20.818162 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb2c5f-1e89-4c21-96aa-b51a20f1c5ca None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:20.820053 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 421/841] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:35:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 01 20:35:20.826515 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e9586c-44f9-43f7-ac9f-e22ba57555e9 None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:20.826989 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e9586c-44f9-43f7-ac9f-e22ba57555e9 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:20.827096 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e9586c-44f9-43f7-ac9f-e22ba57555e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:20.848311 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-f0e9586c-44f9-43f7-ac9f-e22ba57555e9 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:35:20.849782 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-f0e9586c-44f9-43f7-ac9f-e22ba57555e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:35:20.933337 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 421/842] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:35:20 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 01 20:35:21.266408 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceb2c5f-1e89-4c21-96aa-b51a20f1c5ca None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:35:21.378405 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceb2c5f-1e89-4c21-96aa-b51a20f1c5ca None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:35:21.417695 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdf5c27-e11a-4224-98e3-9b4df0a07cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:35:21.418429 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf5c27-e11a-4224-98e3-9b4df0a07cc9 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:21.418715 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf5c27-e11a-4224-98e3-9b4df0a07cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:21.419012 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf5c27-e11a-4224-98e3-9b4df0a07cc9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:21.430871 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdf5c27-e11a-4224-98e3-9b4df0a07cc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 20:35:21.436393 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-cbdf5c27-e11a-4224-98e3-9b4df0a07cc9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 01 20:35:21.436393 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:35:21.436393 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:35:21.436393 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:35:21.436393 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:35:21.436393 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:35:21.436393 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:35:21.436393 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:35:21.436393 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:35:21.436393 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:35:21.436393 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:35:21.436393 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:35:21.436393 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 20:35:21.436393 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 20:35:21.436393 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 20:35:21.436393 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 20:35:21.437535 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 20:35:21.437535 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 20:35:21.437535 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 20:35:21.437535 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 20:35:21.437535 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:35:21.437535 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:35:21.437535 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:35:21.437535 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:35:21.437535 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:35:21.437535 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:35:21.437535 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:35:21.437535 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:35:21.437535 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:35:21.437535 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:35:21.437535 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:35:21.437535 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:35:21.438404 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:35:21.438404 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:35:21.438404 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:35:21.438404 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:35:21.438404 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 20:35:21.438404 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 20:35:21.438404 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 20:35:21.438404 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 20:35:21.438404 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 20:35:21.438404 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 20:35:21.438404 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 01 20:35:21.438404 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:35:21.438404 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 422/843] 10.222.0.23 () {56 vars in 1102 bytes} [Sat Oct 1 20:35:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:35:21.443810 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e9586c-44f9-43f7-ac9f-e22ba57555e9 None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:35:21.557919 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e9586c-44f9-43f7-ac9f-e22ba57555e9 None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:35:21.583797 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:35:21.597107 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57da1ba2-0908-421f-88e9-8a0c71b52c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:35:21.597748 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da1ba2-0908-421f-88e9-8a0c71b52c44 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:21.598014 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da1ba2-0908-421f-88e9-8a0c71b52c44 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:21.598392 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da1ba2-0908-421f-88e9-8a0c71b52c44 None admin] PATH_INFO: `/v3/roles` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:21.599128 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57da1ba2-0908-421f-88e9-8a0c71b52c44 None admin] RBAC: Adding query filter params (name=service) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:35:21.599550 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57da1ba2-0908-421f-88e9-8a0c71b52c44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:35:21.604566 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57da1ba2-0908-421f-88e9-8a0c71b52c44 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:35:21.618281 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 422/844] 10.222.0.23 () {56 vars in 1103 bytes} [Sat Oct 1 20:35:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 20:35:21.621850 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdf5c27-e11a-4224-98e3-9b4df0a07cc9 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:35:21.672178 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:35:21.742723 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdf5c27-e11a-4224-98e3-9b4df0a07cc9 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:35:21.780152 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44827268-60a1-44bc-819a-4edc37aa736b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:35:21.780909 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44827268-60a1-44bc-819a-4edc37aa736b None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:21.781201 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44827268-60a1-44bc-819a-4edc37aa736b None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:21.781466 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44827268-60a1-44bc-819a-4edc37aa736b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:21.794799 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44827268-60a1-44bc-819a-4edc37aa736b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:35:21.796295 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44827268-60a1-44bc-819a-4edc37aa736b None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:35:21.811401 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-44827268-60a1-44bc-819a-4edc37aa736b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:35:21.811401 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:35:21.811401 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:35:21.811401 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:35:21.811401 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:35:21.811401 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:35:21.811401 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:35:21.811401 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:35:21.811401 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:35:21.811401 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:35:21.811401 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:35:21.811401 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:35:21.811401 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 20:35:21.811401 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 20:35:21.811401 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 20:35:21.811401 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 20:35:21.812778 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:35:21.812778 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:35:21.812778 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:35:21.812778 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:35:21.812778 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:35:21.812778 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:35:21.812778 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:35:21.812778 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:35:21.812778 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:35:21.812778 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:35:21.812778 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:35:21.812778 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:35:21.812778 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:35:21.812778 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:35:21.812778 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:35:21.812778 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:35:21.812778 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 20:35:21.813907 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 20:35:21.813907 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:35:21.813907 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:35:21.813907 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 423/845] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Oct 1 20:35:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:35:21.818460 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57da1ba2-0908-421f-88e9-8a0c71b52c44 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:35:21.952991 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57da1ba2-0908-421f-88e9-8a0c71b52c44 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:35:21.995190 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a234d9c-1893-4036-ac3e-6ca0631977a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:35:21.995703 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a234d9c-1893-4036-ac3e-6ca0631977a6 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:21.995980 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a234d9c-1893-4036-ac3e-6ca0631977a6 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:21.996246 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a234d9c-1893-4036-ac3e-6ca0631977a6 None admin] PATH_INFO: `/v3/domains` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:21.996990 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a234d9c-1893-4036-ac3e-6ca0631977a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:35:21.997357 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a234d9c-1893-4036-ac3e-6ca0631977a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:35:21.998889 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a234d9c-1893-4036-ac3e-6ca0631977a6 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:35:22.013730 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 423/846] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Oct 1 20:35:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:35:22.019433 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44827268-60a1-44bc-819a-4edc37aa736b None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:35:22.121189 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:35:22.131340 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44827268-60a1-44bc-819a-4edc37aa736b None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:35:22.170020 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c1d48e-7774-4c9d-a25f-74cffa2dc0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:35:22.170654 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c1d48e-7774-4c9d-a25f-74cffa2dc0ce None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:22.170931 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c1d48e-7774-4c9d-a25f-74cffa2dc0ce None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:22.171200 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c1d48e-7774-4c9d-a25f-74cffa2dc0ce None admin] PATH_INFO: `/v3/users/placement` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:22.180733 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c1d48e-7774-4c9d-a25f-74cffa2dc0ce None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:35:22.182179 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c1d48e-7774-4c9d-a25f-74cffa2dc0ce None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:35:22.196291 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-f6c1d48e-7774-4c9d-a25f-74cffa2dc0ce None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 01 20:35:22.196291 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:35:22.196291 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:35:22.196291 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:35:22.196291 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:35:22.196291 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:35:22.196291 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:35:22.196291 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:35:22.196291 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:35:22.196291 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:35:22.196291 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:35:22.196291 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:35:22.196291 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 01 20:35:22.196291 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 01 20:35:22.196291 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 01 20:35:22.196291 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 01 20:35:22.197566 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:35:22.197566 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:35:22.197566 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 01 20:35:22.197566 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 20:35:22.197566 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 01 20:35:22.197566 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 20:35:22.197566 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:35:22.197566 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:35:22.197566 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:35:22.197566 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:35:22.197566 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:35:22.197566 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:35:22.197566 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:35:22.197566 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:35:22.197566 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:35:22.197566 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:35:22.197566 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:35:22.197566 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:35:22.198552 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:35:22.198552 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:35:22.198552 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 01 20:35:22.198552 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 01 20:35:22.198552 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 01 20:35:22.198552 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 01 20:35:22.198552 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 01 20:35:22.198552 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 01 20:35:22.198552 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 01 20:35:22.198552 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:35:22.198552 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 424/847] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Oct 1 20:35:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:35:22.203556 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a234d9c-1893-4036-ac3e-6ca0631977a6 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:35:22.251336 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:35:22.310598 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a234d9c-1893-4036-ac3e-6ca0631977a6 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:35:22.346596 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc14334-5ccd-49ed-8f9e-0945cf7b4b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:35:22.347193 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc14334-5ccd-49ed-8f9e-0945cf7b4b6d None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:22.347466 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc14334-5ccd-49ed-8f9e-0945cf7b4b6d None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:22.347733 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc14334-5ccd-49ed-8f9e-0945cf7b4b6d None admin] PATH_INFO: `/v3/users` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:22.348446 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc14334-5ccd-49ed-8f9e-0945cf7b4b6d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:35:22.348772 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc14334-5ccd-49ed-8f9e-0945cf7b4b6d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:35:22.350196 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc14334-5ccd-49ed-8f9e-0945cf7b4b6d None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:35:22.369007 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 424/848] 10.222.0.23 () {56 vars in 1143 bytes} [Sat Oct 1 20:35:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 20:35:22.375347 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c1d48e-7774-4c9d-a25f-74cffa2dc0ce None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:35:22.483125 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c1d48e-7774-4c9d-a25f-74cffa2dc0ce None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:35:22.519912 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f695f98a-99d0-4b3b-a319-55a312775ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:35:22.520754 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f695f98a-99d0-4b3b-a319-55a312775ddb None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:22.521032 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f695f98a-99d0-4b3b-a319-55a312775ddb None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:22.521299 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f695f98a-99d0-4b3b-a319-55a312775ddb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:22.534235 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f695f98a-99d0-4b3b-a319-55a312775ddb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:35:22.536274 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f695f98a-99d0-4b3b-a319-55a312775ddb None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:35:22.551932 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-f695f98a-99d0-4b3b-a319-55a312775ddb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:35:22.551932 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:35:22.551932 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:35:22.551932 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:35:22.551932 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:35:22.551932 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:35:22.551932 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:35:22.551932 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:35:22.551932 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:35:22.551932 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:35:22.551932 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:35:22.551932 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:35:22.551932 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 20:35:22.551932 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 20:35:22.551932 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 20:35:22.551932 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 20:35:22.553140 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:35:22.553140 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:35:22.553140 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:35:22.553140 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:35:22.553140 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:35:22.553140 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:35:22.553140 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:35:22.553140 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:35:22.553140 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:35:22.553140 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:35:22.553140 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:35:22.553140 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:35:22.553140 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:35:22.553140 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:35:22.553140 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:35:22.553140 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:35:22.553140 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 20:35:22.554251 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 20:35:22.554251 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:35:22.554251 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:35:22.554251 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 425/849] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Oct 1 20:35:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 01 20:35:22.559260 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc14334-5ccd-49ed-8f9e-0945cf7b4b6d None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:35:22.667094 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc14334-5ccd-49ed-8f9e-0945cf7b4b6d None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:35:22.669861 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:35:22.705103 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bff12d-cc82-44a3-b425-0f766a6884bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:35:22.706053 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bff12d-cc82-44a3-b425-0f766a6884bb None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:22.706322 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bff12d-cc82-44a3-b425-0f766a6884bb None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:22.706595 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bff12d-cc82-44a3-b425-0f766a6884bb None admin] PATH_INFO: `/v3/domains` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:22.707474 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bff12d-cc82-44a3-b425-0f766a6884bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:35:22.707941 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bff12d-cc82-44a3-b425-0f766a6884bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:35:22.709462 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bff12d-cc82-44a3-b425-0f766a6884bb None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:35:22.725451 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 425/850] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Oct 1 20:35:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:35:22.731102 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f695f98a-99d0-4b3b-a319-55a312775ddb None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:35:22.734200 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:35:22.841813 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f695f98a-99d0-4b3b-a319-55a312775ddb None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:35:22.891909 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a6a342-e9b1-44bd-b79d-b5b4fec253ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:35:22.892735 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a6a342-e9b1-44bd-b79d-b5b4fec253ce None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:22.893127 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a6a342-e9b1-44bd-b79d-b5b4fec253ce None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:22.893599 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a6a342-e9b1-44bd-b79d-b5b4fec253ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:22.902981 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a6a342-e9b1-44bd-b79d-b5b4fec253ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:35:22.904415 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a6a342-e9b1-44bd-b79d-b5b4fec253ce None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:35:22.916403 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-d1a6a342-e9b1-44bd-b79d-b5b4fec253ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 20:35:22.916403 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:35:22.916403 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:35:22.916403 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:35:22.916403 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:35:22.916403 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:35:22.916403 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:35:22.916403 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:35:22.916403 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:35:22.916403 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:35:22.916403 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:35:22.916403 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:35:22.916403 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 01 20:35:22.916403 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 01 20:35:22.916403 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 01 20:35:22.917513 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 01 20:35:22.917513 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:35:22.917513 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:35:22.917513 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:35:22.917513 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:35:22.917513 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:35:22.917513 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:35:22.917513 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:35:22.917513 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:35:22.917513 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:35:22.917513 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:35:22.917513 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:35:22.917513 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:35:22.917513 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:35:22.917513 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:35:22.917513 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:35:22.917513 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:35:22.918453 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 01 20:35:22.918453 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 01 20:35:22.918453 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 01 20:35:22.918453 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 01 20:35:22.918453 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 01 20:35:22.918453 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 01 20:35:22.918453 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 20:35:22.918453 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:35:22.918453 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 426/851] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Oct 1 20:35:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 01 20:35:22.923486 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bff12d-cc82-44a3-b425-0f766a6884bb None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:35:23.041239 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bff12d-cc82-44a3-b425-0f766a6884bb None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:35:23.079847 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23f7899-ceb1-4174-8036-db1b1408250b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:35:23.080611 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f7899-ceb1-4174-8036-db1b1408250b None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:23.080890 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f7899-ceb1-4174-8036-db1b1408250b None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:23.081288 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f7899-ceb1-4174-8036-db1b1408250b None admin] PATH_INFO: `/v3/projects` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:23.082041 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23f7899-ceb1-4174-8036-db1b1408250b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:35:23.082410 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23f7899-ceb1-4174-8036-db1b1408250b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:35:23.084001 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23f7899-ceb1-4174-8036-db1b1408250b None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:35:23.098130 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 426/852] 10.222.0.23 () {56 vars in 1148 bytes} [Sat Oct 1 20:35:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 20:35:23.104934 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a6a342-e9b1-44bd-b79d-b5b4fec253ce None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:35:23.174037 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:35:23.211431 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a6a342-e9b1-44bd-b79d-b5b4fec253ce None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:35:23.245151 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8719bd49-3ed1-473b-9125-2ed0183ae3ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:35:23.245918 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8719bd49-3ed1-473b-9125-2ed0183ae3ca None admin] REQUEST_METHOD: `PUT` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:23.246319 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8719bd49-3ed1-473b-9125-2ed0183ae3ca None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:23.246611 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8719bd49-3ed1-473b-9125-2ed0183ae3ca None admin] PATH_INFO: `/v3/projects/8f242c4eeaa04ed19dcdc8ba95b86cfb/users/645c8f9d14a743c2b1103eec2a07c4e8/roles/da1d78af3e8a425e8ce1130b079f8fce` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:23.263089 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8719bd49-3ed1-473b-9125-2ed0183ae3ca None admin] RBAC: Authorizing `identity:create_grant(project_id=8f242c4eeaa04ed19dcdc8ba95b86cfb, user_id=645c8f9d14a743c2b1103eec2a07c4e8, role_id=da1d78af3e8a425e8ce1130b079f8fce)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:35:23.264719 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8719bd49-3ed1-473b-9125-2ed0183ae3ca None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:35:23.278216 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 427/853] 10.222.0.23 () {58 vars in 1439 bytes} [Sat Oct 1 20:35:23 2022] PUT /identity/v3/projects/8f242c4eeaa04ed19dcdc8ba95b86cfb/users/645c8f9d14a743c2b1103eec2a07c4e8/roles/da1d78af3e8a425e8ce1130b079f8fce => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 20:35:25.960515 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88deae0c-8542-4694-9df2-db78a2fecf81 None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:25.961198 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88deae0c-8542-4694-9df2-db78a2fecf81 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:25.961465 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88deae0c-8542-4694-9df2-db78a2fecf81 None None] PATH_INFO: `/` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:25.963493 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 427/854] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:35:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:35:25.970547 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b47e822-a204-41a0-9c2a-daf1b181a99c None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:25.971027 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b47e822-a204-41a0-9c2a-daf1b181a99c None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:25.971147 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b47e822-a204-41a0-9c2a-daf1b181a99c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:25.992116 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-4b47e822-a204-41a0-9c2a-daf1b181a99c None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:35:25.993505 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-4b47e822-a204-41a0-9c2a-daf1b181a99c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:35:26.064160 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 428/855] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:35:25 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 01 20:35:26.400076 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88deae0c-8542-4694-9df2-db78a2fecf81 None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:35:26.428239 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:35:26.515035 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88deae0c-8542-4694-9df2-db78a2fecf81 None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:35:26.554250 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684a4b5d-3e29-4566-9af1-14295d2f6689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:35:26.554943 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a4b5d-3e29-4566-9af1-14295d2f6689 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:26.555301 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a4b5d-3e29-4566-9af1-14295d2f6689 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:26.555585 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a4b5d-3e29-4566-9af1-14295d2f6689 None admin] PATH_INFO: `/v3/roles/service` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:26.567135 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684a4b5d-3e29-4566-9af1-14295d2f6689 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 20:35:26.572333 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application [None req-684a4b5d-3e29-4566-9af1-14295d2f6689 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 01 20:35:26.572333 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:35:26.572333 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:35:26.572333 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:35:26.572333 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:35:26.572333 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:35:26.572333 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:35:26.572333 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:35:26.572333 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:35:26.572333 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:35:26.572333 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:35:26.572333 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:35:26.572333 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 20:35:26.572333 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 20:35:26.572333 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 20:35:26.572333 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 20:35:26.573815 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 20:35:26.573815 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 20:35:26.573815 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 20:35:26.573815 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 20:35:26.573815 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:35:26.573815 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:35:26.573815 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:35:26.573815 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:35:26.573815 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:35:26.573815 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:35:26.573815 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:35:26.573815 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application with Lock( Oct 01 20:35:26.573815 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:35:26.573815 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:35:26.573815 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:35:26.573815 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:35:26.574838 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:35:26.574838 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:35:26.574838 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:35:26.574838 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:35:26.574838 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 20:35:26.574838 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 20:35:26.574838 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 20:35:26.574838 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 20:35:26.574838 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 20:35:26.574838 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 20:35:26.574838 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 01 20:35:26.574838 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:35:26.574838 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 428/856] 10.222.0.23 () {56 vars in 1102 bytes} [Sat Oct 1 20:35:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:35:26.579785 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b47e822-a204-41a0-9c2a-daf1b181a99c None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:35:26.626880 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:35:26.692094 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b47e822-a204-41a0-9c2a-daf1b181a99c None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:35:26.736851 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd993571-d8f0-4766-93c5-2e8aa631b33b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:35:26.737459 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd993571-d8f0-4766-93c5-2e8aa631b33b None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:26.737742 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd993571-d8f0-4766-93c5-2e8aa631b33b None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:26.738017 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd993571-d8f0-4766-93c5-2e8aa631b33b None admin] PATH_INFO: `/v3/roles` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:26.738680 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd993571-d8f0-4766-93c5-2e8aa631b33b None admin] RBAC: Adding query filter params (name=service) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:35:26.738981 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd993571-d8f0-4766-93c5-2e8aa631b33b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:35:26.740599 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd993571-d8f0-4766-93c5-2e8aa631b33b None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:35:26.749791 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 429/857] 10.222.0.23 () {56 vars in 1103 bytes} [Sat Oct 1 20:35:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:35:26.755860 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684a4b5d-3e29-4566-9af1-14295d2f6689 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:35:26.866495 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:35:26.888052 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684a4b5d-3e29-4566-9af1-14295d2f6689 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:35:26.931088 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663c1525-70fb-445f-a198-9270dc42d18e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:35:26.931888 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c1525-70fb-445f-a198-9270dc42d18e None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:26.932206 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c1525-70fb-445f-a198-9270dc42d18e None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:26.932488 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c1525-70fb-445f-a198-9270dc42d18e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:26.943156 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663c1525-70fb-445f-a198-9270dc42d18e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:35:26.944665 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663c1525-70fb-445f-a198-9270dc42d18e None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:35:26.961427 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application [None req-663c1525-70fb-445f-a198-9270dc42d18e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:35:26.961427 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:35:26.961427 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:35:26.961427 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:35:26.961427 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:35:26.961427 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:35:26.961427 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:35:26.961427 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:35:26.961427 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:35:26.961427 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:35:26.961427 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:35:26.961427 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:35:26.961427 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 20:35:26.961427 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 20:35:26.961427 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 20:35:26.961427 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 20:35:26.963039 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:35:26.963039 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:35:26.963039 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:35:26.963039 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:35:26.963039 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:35:26.963039 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:35:26.963039 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:35:26.963039 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application with Lock( Oct 01 20:35:26.963039 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:35:26.963039 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:35:26.963039 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:35:26.963039 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:35:26.963039 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:35:26.963039 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:35:26.963039 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:35:26.963039 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:35:26.963039 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 20:35:26.964064 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 20:35:26.964064 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:35:26.964064 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:35:26.964064 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 429/858] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Oct 1 20:35:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:35:26.969492 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd993571-d8f0-4766-93c5-2e8aa631b33b None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:35:27.082179 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd993571-d8f0-4766-93c5-2e8aa631b33b None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:35:27.085002 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:35:27.122239 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b2fa0b-8879-454e-8fde-086d2f6d14be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:35:27.122840 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b2fa0b-8879-454e-8fde-086d2f6d14be None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:27.123178 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b2fa0b-8879-454e-8fde-086d2f6d14be None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:27.123502 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b2fa0b-8879-454e-8fde-086d2f6d14be None admin] PATH_INFO: `/v3/domains` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:27.124158 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b2fa0b-8879-454e-8fde-086d2f6d14be None admin] RBAC: Adding query filter params (name=Default) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:35:27.124459 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b2fa0b-8879-454e-8fde-086d2f6d14be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:35:27.126021 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b2fa0b-8879-454e-8fde-086d2f6d14be None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:35:27.138319 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 430/859] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Oct 1 20:35:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:35:27.144474 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663c1525-70fb-445f-a198-9270dc42d18e None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:35:27.263861 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663c1525-70fb-445f-a198-9270dc42d18e None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:35:27.304194 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de749c92-07d1-41b9-9278-0dade348f076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:35:27.305003 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de749c92-07d1-41b9-9278-0dade348f076 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:27.305322 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de749c92-07d1-41b9-9278-0dade348f076 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:27.305654 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de749c92-07d1-41b9-9278-0dade348f076 None admin] PATH_INFO: `/v3/users/placement` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:27.308725 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:35:27.314553 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de749c92-07d1-41b9-9278-0dade348f076 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:35:27.316733 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de749c92-07d1-41b9-9278-0dade348f076 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:35:27.330325 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application [None req-de749c92-07d1-41b9-9278-0dade348f076 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 01 20:35:27.330325 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:35:27.330325 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:35:27.330325 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:35:27.330325 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:35:27.330325 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:35:27.330325 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:35:27.330325 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:35:27.330325 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:35:27.330325 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:35:27.330325 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:35:27.330325 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:35:27.330325 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 01 20:35:27.330325 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 01 20:35:27.330325 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 01 20:35:27.330325 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 01 20:35:27.331418 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:35:27.331418 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:35:27.331418 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 01 20:35:27.331418 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 20:35:27.331418 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 01 20:35:27.331418 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 20:35:27.331418 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:35:27.331418 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:35:27.331418 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:35:27.331418 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:35:27.331418 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:35:27.331418 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application with Lock( Oct 01 20:35:27.331418 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:35:27.331418 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:35:27.331418 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:35:27.331418 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:35:27.331418 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:35:27.331418 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:35:27.332403 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:35:27.332403 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:35:27.332403 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 01 20:35:27.332403 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 01 20:35:27.332403 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 01 20:35:27.332403 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 01 20:35:27.332403 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 01 20:35:27.332403 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 01 20:35:27.332403 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 01 20:35:27.332403 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:35:27.332403 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 430/860] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Oct 1 20:35:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:35:27.339053 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b2fa0b-8879-454e-8fde-086d2f6d14be None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:35:27.447664 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b2fa0b-8879-454e-8fde-086d2f6d14be None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:35:27.486932 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba96da75-53c4-4001-bc08-d9e6fca23da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:35:27.487587 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba96da75-53c4-4001-bc08-d9e6fca23da3 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:27.487929 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba96da75-53c4-4001-bc08-d9e6fca23da3 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:27.488226 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba96da75-53c4-4001-bc08-d9e6fca23da3 None admin] PATH_INFO: `/v3/users` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:27.489059 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba96da75-53c4-4001-bc08-d9e6fca23da3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:35:27.489361 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba96da75-53c4-4001-bc08-d9e6fca23da3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:35:27.491019 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba96da75-53c4-4001-bc08-d9e6fca23da3 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:35:27.510223 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 431/861] 10.222.0.23 () {56 vars in 1143 bytes} [Sat Oct 1 20:35:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:35:27.516409 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de749c92-07d1-41b9-9278-0dade348f076 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:35:27.624969 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de749c92-07d1-41b9-9278-0dade348f076 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:35:27.662080 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7851e399-0f7f-45e4-9a73-48b4f5c3bd62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:35:27.662729 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851e399-0f7f-45e4-9a73-48b4f5c3bd62 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:27.663006 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851e399-0f7f-45e4-9a73-48b4f5c3bd62 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:27.663879 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851e399-0f7f-45e4-9a73-48b4f5c3bd62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:27.735069 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:35:27.743617 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7851e399-0f7f-45e4-9a73-48b4f5c3bd62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:35:27.745537 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7851e399-0f7f-45e4-9a73-48b4f5c3bd62 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:35:27.856218 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 431/862] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Oct 1 20:35:27 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 01 20:35:27.863096 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba96da75-53c4-4001-bc08-d9e6fca23da3 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:35:27.890992 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:35:27.978734 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba96da75-53c4-4001-bc08-d9e6fca23da3 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:35:28.017903 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dea5e03-e992-49d3-a281-c4e4f6ca689d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:35:28.018615 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea5e03-e992-49d3-a281-c4e4f6ca689d None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:28.018875 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea5e03-e992-49d3-a281-c4e4f6ca689d None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:28.019109 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea5e03-e992-49d3-a281-c4e4f6ca689d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:28.030844 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dea5e03-e992-49d3-a281-c4e4f6ca689d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:35:28.032398 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dea5e03-e992-49d3-a281-c4e4f6ca689d None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:35:28.049727 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-2dea5e03-e992-49d3-a281-c4e4f6ca689d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:35:28.049727 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:35:28.049727 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:35:28.049727 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:35:28.049727 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:35:28.049727 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:35:28.049727 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:35:28.049727 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:35:28.049727 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:35:28.049727 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:35:28.049727 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:35:28.049727 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:35:28.049727 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 20:35:28.049727 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 20:35:28.049727 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 20:35:28.049727 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 20:35:28.055551 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:35:28.055551 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:35:28.055551 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:35:28.055551 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:35:28.055551 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:35:28.055551 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:35:28.055551 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:35:28.055551 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:35:28.055551 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:35:28.055551 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:35:28.055551 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:35:28.055551 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:35:28.055551 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:35:28.055551 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:35:28.055551 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:35:28.055551 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:35:28.055551 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 20:35:28.056646 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 20:35:28.056646 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:35:28.056646 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:35:28.056646 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 432/863] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Oct 1 20:35:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:35:28.056957 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7851e399-0f7f-45e4-9a73-48b4f5c3bd62 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:35:28.166418 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:35:28.175022 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7851e399-0f7f-45e4-9a73-48b4f5c3bd62 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:35:28.217406 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bd909c-ae19-47aa-a04b-1f332e71aefa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:35:28.218242 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd909c-ae19-47aa-a04b-1f332e71aefa None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:28.218603 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd909c-ae19-47aa-a04b-1f332e71aefa None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:28.218956 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd909c-ae19-47aa-a04b-1f332e71aefa None admin] PATH_INFO: `/v3/domains` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:28.219807 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bd909c-ae19-47aa-a04b-1f332e71aefa None admin] RBAC: Adding query filter params (name=Default) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:35:28.220109 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bd909c-ae19-47aa-a04b-1f332e71aefa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:35:28.222478 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bd909c-ae19-47aa-a04b-1f332e71aefa None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:35:28.235267 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 432/864] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Oct 1 20:35:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:35:28.241981 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dea5e03-e992-49d3-a281-c4e4f6ca689d None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:35:28.335357 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:35:28.363947 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dea5e03-e992-49d3-a281-c4e4f6ca689d None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:35:28.400785 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a2e770-0eb0-42fa-8e3b-b8fcfcaacd0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:35:28.401416 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a2e770-0eb0-42fa-8e3b-b8fcfcaacd0e None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:28.401694 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a2e770-0eb0-42fa-8e3b-b8fcfcaacd0e None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:28.401962 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a2e770-0eb0-42fa-8e3b-b8fcfcaacd0e None admin] PATH_INFO: `/v3/projects/service` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:28.408729 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a2e770-0eb0-42fa-8e3b-b8fcfcaacd0e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:35:28.410204 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a2e770-0eb0-42fa-8e3b-b8fcfcaacd0e None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:35:28.421877 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-72a2e770-0eb0-42fa-8e3b-b8fcfcaacd0e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 20:35:28.421877 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:35:28.421877 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:35:28.421877 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:35:28.421877 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:35:28.421877 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:35:28.421877 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:35:28.421877 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:35:28.421877 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:35:28.421877 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:35:28.421877 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:35:28.421877 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:35:28.421877 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 01 20:35:28.421877 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 01 20:35:28.421877 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 01 20:35:28.427943 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 01 20:35:28.427943 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:35:28.427943 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:35:28.427943 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:35:28.427943 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:35:28.427943 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:35:28.427943 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:35:28.427943 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:35:28.427943 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:35:28.427943 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:35:28.427943 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:35:28.427943 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:35:28.427943 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:35:28.427943 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:35:28.427943 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:35:28.427943 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:35:28.427943 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:35:28.429964 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 01 20:35:28.429964 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 01 20:35:28.429964 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 01 20:35:28.429964 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 01 20:35:28.429964 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 01 20:35:28.429964 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 01 20:35:28.429964 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 20:35:28.429964 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:35:28.429964 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 433/865] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Oct 1 20:35:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 01 20:35:28.430586 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bd909c-ae19-47aa-a04b-1f332e71aefa None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:35:28.546220 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bd909c-ae19-47aa-a04b-1f332e71aefa None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:35:28.585867 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a325bc42-c718-4be7-ada5-f4a8bfcc7b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:35:28.586489 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a325bc42-c718-4be7-ada5-f4a8bfcc7b73 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:28.586794 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a325bc42-c718-4be7-ada5-f4a8bfcc7b73 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:28.587092 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a325bc42-c718-4be7-ada5-f4a8bfcc7b73 None admin] PATH_INFO: `/v3/projects` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:28.587792 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a325bc42-c718-4be7-ada5-f4a8bfcc7b73 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:35:28.588096 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a325bc42-c718-4be7-ada5-f4a8bfcc7b73 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:35:28.589588 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a325bc42-c718-4be7-ada5-f4a8bfcc7b73 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:35:28.602494 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 433/866] 10.222.0.23 () {56 vars in 1148 bytes} [Sat Oct 1 20:35:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:35:28.608516 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a2e770-0eb0-42fa-8e3b-b8fcfcaacd0e None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:35:28.721475 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a2e770-0eb0-42fa-8e3b-b8fcfcaacd0e None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:35:28.760397 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b284ca2-5b00-4374-8fe6-46086f5e38a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:35:28.761091 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b284ca2-5b00-4374-8fe6-46086f5e38a2 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:28.761492 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b284ca2-5b00-4374-8fe6-46086f5e38a2 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:28.761899 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b284ca2-5b00-4374-8fe6-46086f5e38a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:28.762828 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b284ca2-5b00-4374-8fe6-46086f5e38a2 None admin] RBAC: Adding query filter params (role.id=da1d78af3e8a425e8ce1130b079f8fce, scope.project.id=8f242c4eeaa04ed19dcdc8ba95b86cfb, user.id=645c8f9d14a743c2b1103eec2a07c4e8) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:35:28.763230 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b284ca2-5b00-4374-8fe6-46086f5e38a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:35:28.764678 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b284ca2-5b00-4374-8fe6-46086f5e38a2 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:35:28.766498 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:35:28.773103 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 434/867] 10.222.0.23 () {56 vars in 1374 bytes} [Sat Oct 1 20:35:28 2022] GET /identity/v3/role_assignments?user.id=645c8f9d14a743c2b1103eec2a07c4e8&scope.project.id=8f242c4eeaa04ed19dcdc8ba95b86cfb&role.id=da1d78af3e8a425e8ce1130b079f8fce => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:35:31.308939 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60de0c9-4677-42f3-b57b-b252532b9e73 None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:31.309508 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60de0c9-4677-42f3-b57b-b252532b9e73 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:31.309508 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60de0c9-4677-42f3-b57b-b252532b9e73 None None] PATH_INFO: `/` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:31.310792 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 434/868] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:35:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:35:31.316266 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e1e64-d703-4d60-8e22-af417ca67939 None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:31.316703 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e1e64-d703-4d60-8e22-af417ca67939 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:31.316865 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e1e64-d703-4d60-8e22-af417ca67939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:31.335868 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-cd3e1e64-d703-4d60-8e22-af417ca67939 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:35:31.337095 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-cd3e1e64-d703-4d60-8e22-af417ca67939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:35:31.402392 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 435/869] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:35:31 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 01 20:35:31.732275 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60de0c9-4677-42f3-b57b-b252532b9e73 None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:35:31.750725 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:35:31.831799 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60de0c9-4677-42f3-b57b-b252532b9e73 None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:35:31.867270 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93682488-4f61-46fc-90b7-a03f0c4884b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:35:31.867892 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93682488-4f61-46fc-90b7-a03f0c4884b7 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:31.868169 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93682488-4f61-46fc-90b7-a03f0c4884b7 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:31.868460 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93682488-4f61-46fc-90b7-a03f0c4884b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:31.880215 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93682488-4f61-46fc-90b7-a03f0c4884b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 20:35:31.887045 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application [None req-93682488-4f61-46fc-90b7-a03f0c4884b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 20:35:31.887045 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:35:31.887045 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:35:31.887045 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:35:31.887045 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:35:31.887045 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:35:31.887045 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:35:31.887045 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:35:31.887045 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:35:31.887045 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:35:31.887045 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:35:31.887045 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:35:31.887045 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 20:35:31.887045 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 20:35:31.887045 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 20:35:31.887045 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 20:35:31.888026 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 20:35:31.888026 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 20:35:31.888026 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 20:35:31.888026 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 20:35:31.888026 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:35:31.888026 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:35:31.888026 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:35:31.888026 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:35:31.888026 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:35:31.888026 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:35:31.888026 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:35:31.888026 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application with Lock( Oct 01 20:35:31.888026 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:35:31.888026 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:35:31.888026 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:35:31.888026 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:35:31.889114 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:35:31.889114 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:35:31.889114 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:35:31.889114 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:35:31.889114 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 20:35:31.889114 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 20:35:31.889114 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 20:35:31.889114 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 20:35:31.889114 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 20:35:31.889114 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 20:35:31.889114 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 20:35:31.889114 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:35:31.889114 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 435/870] 10.222.0.23 () {56 vars in 1096 bytes} [Sat Oct 1 20:35:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:35:31.898554 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3e1e64-d703-4d60-8e22-af417ca67939 None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:35:31.998703 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3e1e64-d703-4d60-8e22-af417ca67939 None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:35:32.025535 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:35:32.037134 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd4303f-c003-45fe-99e4-020df853ea25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:35:32.038544 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd4303f-c003-45fe-99e4-020df853ea25 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:32.038939 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd4303f-c003-45fe-99e4-020df853ea25 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:32.039216 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd4303f-c003-45fe-99e4-020df853ea25 None admin] PATH_INFO: `/v3/roles` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:32.039875 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd4303f-c003-45fe-99e4-020df853ea25 None admin] RBAC: Adding query filter params (name=admin) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:35:32.040177 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd4303f-c003-45fe-99e4-020df853ea25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:35:32.041569 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd4303f-c003-45fe-99e4-020df853ea25 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:35:32.049486 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 436/871] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Oct 1 20:35:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:35:32.055473 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93682488-4f61-46fc-90b7-a03f0c4884b7 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:35:32.130917 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:35:32.154438 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93682488-4f61-46fc-90b7-a03f0c4884b7 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:35:32.188593 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110cf1e0-6b76-4eba-8e27-a0de45a1bd64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:35:32.189220 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110cf1e0-6b76-4eba-8e27-a0de45a1bd64 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:32.189492 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110cf1e0-6b76-4eba-8e27-a0de45a1bd64 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:32.190017 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110cf1e0-6b76-4eba-8e27-a0de45a1bd64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:32.199872 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110cf1e0-6b76-4eba-8e27-a0de45a1bd64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:35:32.201342 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110cf1e0-6b76-4eba-8e27-a0de45a1bd64 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:35:32.216117 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application [None req-110cf1e0-6b76-4eba-8e27-a0de45a1bd64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:35:32.216117 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:35:32.216117 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:35:32.216117 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:35:32.216117 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:35:32.216117 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:35:32.216117 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:35:32.216117 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:35:32.216117 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:35:32.216117 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:35:32.216117 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:35:32.216117 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:35:32.216117 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 20:35:32.216117 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 20:35:32.216117 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 20:35:32.216117 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 20:35:32.217154 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:35:32.217154 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:35:32.217154 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:35:32.217154 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:35:32.217154 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:35:32.217154 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:35:32.217154 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:35:32.217154 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application with Lock( Oct 01 20:35:32.217154 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:35:32.217154 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:35:32.217154 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:35:32.217154 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:35:32.217154 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:35:32.217154 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:35:32.217154 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:35:32.217154 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:35:32.217154 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 20:35:32.218071 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 20:35:32.218071 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:35:32.218071 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:35:32.218071 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 436/872] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Oct 1 20:35:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:35:32.222950 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd4303f-c003-45fe-99e4-020df853ea25 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:35:32.322113 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd4303f-c003-45fe-99e4-020df853ea25 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:35:32.354774 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93512a2b-619b-460e-8a96-fef28426ed24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:35:32.355357 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93512a2b-619b-460e-8a96-fef28426ed24 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:32.355632 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93512a2b-619b-460e-8a96-fef28426ed24 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:32.355903 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93512a2b-619b-460e-8a96-fef28426ed24 None admin] PATH_INFO: `/v3/domains` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:32.356555 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93512a2b-619b-460e-8a96-fef28426ed24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:35:32.356858 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93512a2b-619b-460e-8a96-fef28426ed24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:35:32.358214 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93512a2b-619b-460e-8a96-fef28426ed24 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:35:32.370205 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 437/873] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Oct 1 20:35:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:35:32.375836 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110cf1e0-6b76-4eba-8e27-a0de45a1bd64 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:35:32.474390 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110cf1e0-6b76-4eba-8e27-a0de45a1bd64 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:35:32.499520 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:35:32.508548 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf4490f-5181-4266-a883-401432d1dd27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:35:32.509182 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf4490f-5181-4266-a883-401432d1dd27 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:32.509462 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf4490f-5181-4266-a883-401432d1dd27 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:32.509734 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf4490f-5181-4266-a883-401432d1dd27 None admin] PATH_INFO: `/v3/users/placement` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:32.517819 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf4490f-5181-4266-a883-401432d1dd27 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:35:32.519302 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf4490f-5181-4266-a883-401432d1dd27 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:35:32.530928 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application [None req-7cf4490f-5181-4266-a883-401432d1dd27 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 01 20:35:32.530928 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:35:32.530928 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:35:32.530928 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:35:32.530928 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:35:32.530928 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:35:32.530928 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:35:32.530928 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:35:32.530928 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:35:32.530928 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:35:32.530928 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:35:32.530928 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:35:32.530928 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 01 20:35:32.530928 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 01 20:35:32.530928 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 01 20:35:32.530928 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 01 20:35:32.532022 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:35:32.532022 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:35:32.532022 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 01 20:35:32.532022 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 20:35:32.532022 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 01 20:35:32.532022 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 20:35:32.532022 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:35:32.532022 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:35:32.532022 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:35:32.532022 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:35:32.532022 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:35:32.532022 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application with Lock( Oct 01 20:35:32.532022 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:35:32.532022 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:35:32.532022 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:35:32.532022 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:35:32.532022 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:35:32.532022 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:35:32.533196 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:35:32.533196 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:35:32.533196 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 01 20:35:32.533196 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 01 20:35:32.533196 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 01 20:35:32.533196 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 01 20:35:32.533196 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 01 20:35:32.533196 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 01 20:35:32.533196 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 01 20:35:32.533196 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:35:32.533196 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 437/874] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Oct 1 20:35:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:35:32.538102 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93512a2b-619b-460e-8a96-fef28426ed24 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:35:32.587501 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:35:32.635938 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93512a2b-619b-460e-8a96-fef28426ed24 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:35:32.667541 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7d1076-10e1-44b4-b8c9-7b5652409886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:35:32.668127 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d1076-10e1-44b4-b8c9-7b5652409886 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:32.668399 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d1076-10e1-44b4-b8c9-7b5652409886 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:32.668696 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d1076-10e1-44b4-b8c9-7b5652409886 None admin] PATH_INFO: `/v3/users` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:32.669395 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7d1076-10e1-44b4-b8c9-7b5652409886 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:35:32.669690 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7d1076-10e1-44b4-b8c9-7b5652409886 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:35:32.671091 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7d1076-10e1-44b4-b8c9-7b5652409886 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:35:32.687696 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 438/875] 10.222.0.23 () {56 vars in 1143 bytes} [Sat Oct 1 20:35:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:35:32.694195 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf4490f-5181-4266-a883-401432d1dd27 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:35:32.790768 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf4490f-5181-4266-a883-401432d1dd27 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:35:32.823429 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592277a1-ef98-4557-8e13-4e3e76c01353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:35:32.824011 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592277a1-ef98-4557-8e13-4e3e76c01353 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:32.824283 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592277a1-ef98-4557-8e13-4e3e76c01353 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:32.824571 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592277a1-ef98-4557-8e13-4e3e76c01353 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:32.886063 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:35:32.904082 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592277a1-ef98-4557-8e13-4e3e76c01353 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:35:32.906824 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592277a1-ef98-4557-8e13-4e3e76c01353 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:35:33.002677 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 438/876] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Oct 1 20:35:32 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 01 20:35:33.008490 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7d1076-10e1-44b4-b8c9-7b5652409886 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:35:33.105564 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7d1076-10e1-44b4-b8c9-7b5652409886 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:35:33.114327 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:35:33.138564 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0511e2-ae9e-44d7-b4b2-2949337a4025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:35:33.139107 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0511e2-ae9e-44d7-b4b2-2949337a4025 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:33.139378 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0511e2-ae9e-44d7-b4b2-2949337a4025 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:33.139642 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0511e2-ae9e-44d7-b4b2-2949337a4025 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:33.149841 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0511e2-ae9e-44d7-b4b2-2949337a4025 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:35:33.151263 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0511e2-ae9e-44d7-b4b2-2949337a4025 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:35:33.165399 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-be0511e2-ae9e-44d7-b4b2-2949337a4025 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:35:33.165399 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:35:33.165399 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:35:33.165399 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:35:33.165399 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:35:33.165399 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:35:33.165399 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:35:33.165399 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:35:33.165399 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:35:33.165399 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:35:33.165399 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:35:33.165399 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:35:33.165399 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 20:35:33.165399 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 20:35:33.165399 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 20:35:33.165399 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 20:35:33.166525 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:35:33.166525 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:35:33.166525 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:35:33.166525 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:35:33.166525 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:35:33.166525 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:35:33.166525 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:35:33.166525 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:35:33.166525 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:35:33.166525 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:35:33.166525 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:35:33.166525 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:35:33.166525 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:35:33.166525 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:35:33.166525 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:35:33.166525 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:35:33.166525 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 20:35:33.167680 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 20:35:33.167680 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:35:33.167680 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:35:33.167680 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 439/877] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Oct 1 20:35:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:35:33.173131 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592277a1-ef98-4557-8e13-4e3e76c01353 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:35:33.257841 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:35:33.270222 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592277a1-ef98-4557-8e13-4e3e76c01353 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:35:33.303289 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcda6002-456d-4814-b2c2-e7e23b9e50f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:35:33.303884 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcda6002-456d-4814-b2c2-e7e23b9e50f7 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:33.304163 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcda6002-456d-4814-b2c2-e7e23b9e50f7 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:33.304435 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcda6002-456d-4814-b2c2-e7e23b9e50f7 None admin] PATH_INFO: `/v3/domains` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:33.305095 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcda6002-456d-4814-b2c2-e7e23b9e50f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:35:33.305394 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcda6002-456d-4814-b2c2-e7e23b9e50f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:35:33.306754 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcda6002-456d-4814-b2c2-e7e23b9e50f7 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:35:33.317901 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 439/878] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Oct 1 20:35:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:35:33.324433 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0511e2-ae9e-44d7-b4b2-2949337a4025 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:35:33.421823 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0511e2-ae9e-44d7-b4b2-2949337a4025 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:35:33.455474 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f27fa69-fb5f-4494-ae59-e6ba26ccac59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:35:33.456084 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f27fa69-fb5f-4494-ae59-e6ba26ccac59 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:33.456362 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f27fa69-fb5f-4494-ae59-e6ba26ccac59 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:33.456665 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f27fa69-fb5f-4494-ae59-e6ba26ccac59 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:33.463259 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f27fa69-fb5f-4494-ae59-e6ba26ccac59 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:35:33.464724 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f27fa69-fb5f-4494-ae59-e6ba26ccac59 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:35:33.475676 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-4f27fa69-fb5f-4494-ae59-e6ba26ccac59 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 20:35:33.475676 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:35:33.475676 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:35:33.475676 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:35:33.475676 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:35:33.475676 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:35:33.475676 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:35:33.475676 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:35:33.475676 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:35:33.475676 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:35:33.475676 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:35:33.475676 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:35:33.475676 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 01 20:35:33.475676 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 01 20:35:33.475676 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 01 20:35:33.481346 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 01 20:35:33.481346 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:35:33.481346 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:35:33.481346 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:35:33.481346 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:35:33.481346 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:35:33.481346 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:35:33.481346 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:35:33.481346 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:35:33.481346 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:35:33.481346 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:35:33.481346 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:35:33.481346 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:35:33.481346 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:35:33.481346 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:35:33.481346 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:35:33.481346 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:35:33.482467 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 01 20:35:33.482467 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 01 20:35:33.482467 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 01 20:35:33.482467 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 01 20:35:33.482467 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 01 20:35:33.482467 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 01 20:35:33.482467 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 20:35:33.482467 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:35:33.482467 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 440/879] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Oct 1 20:35:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:35:33.483058 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcda6002-456d-4814-b2c2-e7e23b9e50f7 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:35:33.580106 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcda6002-456d-4814-b2c2-e7e23b9e50f7 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:35:33.612263 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee2a420-b48d-4844-a578-6c370443676c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:35:33.612883 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2a420-b48d-4844-a578-6c370443676c None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:33.613164 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2a420-b48d-4844-a578-6c370443676c None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:33.613437 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2a420-b48d-4844-a578-6c370443676c None admin] PATH_INFO: `/v3/projects` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:33.614123 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee2a420-b48d-4844-a578-6c370443676c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:35:33.614430 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee2a420-b48d-4844-a578-6c370443676c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:35:33.616408 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee2a420-b48d-4844-a578-6c370443676c None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:35:33.627909 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 440/880] 10.222.0.23 () {56 vars in 1148 bytes} [Sat Oct 1 20:35:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 20:35:33.633991 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f27fa69-fb5f-4494-ae59-e6ba26ccac59 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:35:33.656118 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:35:33.733696 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f27fa69-fb5f-4494-ae59-e6ba26ccac59 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:35:33.766978 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016e366d-f4c7-4c49-a47d-724be8a0ac08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:35:33.767678 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016e366d-f4c7-4c49-a47d-724be8a0ac08 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:33.767955 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016e366d-f4c7-4c49-a47d-724be8a0ac08 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:33.768226 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016e366d-f4c7-4c49-a47d-724be8a0ac08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:33.768970 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016e366d-f4c7-4c49-a47d-724be8a0ac08 None admin] RBAC: Adding query filter params (role.id=d11e7ba2f1fa41ff8ea8dda2a8d1466f, scope.project.id=8f242c4eeaa04ed19dcdc8ba95b86cfb, user.id=645c8f9d14a743c2b1103eec2a07c4e8) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:35:33.769274 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016e366d-f4c7-4c49-a47d-724be8a0ac08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:35:33.770694 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016e366d-f4c7-4c49-a47d-724be8a0ac08 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:35:33.776687 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 441/881] 10.222.0.23 () {56 vars in 1374 bytes} [Sat Oct 1 20:35:33 2022] GET /identity/v3/role_assignments?user.id=645c8f9d14a743c2b1103eec2a07c4e8&scope.project.id=8f242c4eeaa04ed19dcdc8ba95b86cfb&role.id=d11e7ba2f1fa41ff8ea8dda2a8d1466f => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:35:36.212782 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b3204-c7ff-4097-a80d-d7dfc5441c61 None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:36.213282 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b3204-c7ff-4097-a80d-d7dfc5441c61 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:36.213372 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b3204-c7ff-4097-a80d-d7dfc5441c61 None None] PATH_INFO: `/` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:36.214644 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 441/882] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:35:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:35:36.219626 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e8d9a-dfc4-4699-9622-8cfac3594a46 None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:36.220031 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e8d9a-dfc4-4699-9622-8cfac3594a46 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:36.220169 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e8d9a-dfc4-4699-9622-8cfac3594a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:36.239301 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-bc0e8d9a-dfc4-4699-9622-8cfac3594a46 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:35:36.241104 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-bc0e8d9a-dfc4-4699-9622-8cfac3594a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:35:36.305012 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 442/883] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:35:36 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 01 20:35:36.630565 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525b3204-c7ff-4097-a80d-d7dfc5441c61 None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:35:36.641363 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:35:36.731230 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525b3204-c7ff-4097-a80d-d7dfc5441c61 None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:35:36.764653 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7fcc6f-7d45-441b-8208-e3eae87102ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:35:36.765259 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7fcc6f-7d45-441b-8208-e3eae87102ef None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:36.765529 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7fcc6f-7d45-441b-8208-e3eae87102ef None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:36.765793 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7fcc6f-7d45-441b-8208-e3eae87102ef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:36.776010 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7fcc6f-7d45-441b-8208-e3eae87102ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 20:35:36.780827 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application [None req-9d7fcc6f-7d45-441b-8208-e3eae87102ef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 20:35:36.780827 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:35:36.780827 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:35:36.780827 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:35:36.780827 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:35:36.780827 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:35:36.780827 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:35:36.780827 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:35:36.780827 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:35:36.780827 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:35:36.780827 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:35:36.780827 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:35:36.780827 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 20:35:36.780827 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 20:35:36.780827 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 20:35:36.780827 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 20:35:36.781937 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 20:35:36.781937 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 20:35:36.781937 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 20:35:36.781937 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 20:35:36.781937 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:35:36.781937 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:35:36.781937 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:35:36.781937 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:35:36.781937 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:35:36.781937 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:35:36.781937 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:35:36.781937 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application with Lock( Oct 01 20:35:36.781937 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:35:36.781937 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:35:36.781937 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:35:36.781937 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:35:36.782955 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:35:36.782955 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:35:36.782955 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:35:36.782955 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:35:36.782955 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 20:35:36.782955 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 20:35:36.782955 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 20:35:36.782955 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 20:35:36.782955 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 20:35:36.782955 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 20:35:36.782955 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 20:35:36.782955 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:35:36.782955 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 442/884] 10.222.0.23 () {56 vars in 1096 bytes} [Sat Oct 1 20:35:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:35:36.787907 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0e8d9a-dfc4-4699-9622-8cfac3594a46 None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:35:36.802452 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:35:36.891406 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0e8d9a-dfc4-4699-9622-8cfac3594a46 None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:35:36.931534 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df502708-956d-4216-ac35-bbaf711ef5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:35:36.932131 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df502708-956d-4216-ac35-bbaf711ef5a7 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:36.932407 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df502708-956d-4216-ac35-bbaf711ef5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:36.932711 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df502708-956d-4216-ac35-bbaf711ef5a7 None admin] PATH_INFO: `/v3/roles` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:36.933365 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df502708-956d-4216-ac35-bbaf711ef5a7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:35:36.933665 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df502708-956d-4216-ac35-bbaf711ef5a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:35:36.935023 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df502708-956d-4216-ac35-bbaf711ef5a7 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:35:36.943171 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 443/885] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Oct 1 20:35:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:35:36.949402 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7fcc6f-7d45-441b-8208-e3eae87102ef None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:35:37.012998 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:35:37.045401 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7fcc6f-7d45-441b-8208-e3eae87102ef None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:35:37.077464 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa3777e-359e-43b9-ad91-e970ef4d4546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:35:37.078072 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa3777e-359e-43b9-ad91-e970ef4d4546 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:37.078345 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa3777e-359e-43b9-ad91-e970ef4d4546 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:37.078612 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa3777e-359e-43b9-ad91-e970ef4d4546 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:37.089165 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa3777e-359e-43b9-ad91-e970ef4d4546 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:35:37.090588 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa3777e-359e-43b9-ad91-e970ef4d4546 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:35:37.104331 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application [None req-5aa3777e-359e-43b9-ad91-e970ef4d4546 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:35:37.104331 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:35:37.104331 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:35:37.104331 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:35:37.104331 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:35:37.104331 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:35:37.104331 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:35:37.104331 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:35:37.104331 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:35:37.104331 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:35:37.104331 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:35:37.104331 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:35:37.104331 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 20:35:37.104331 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 20:35:37.104331 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 20:35:37.104331 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 20:35:37.105312 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:35:37.105312 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:35:37.105312 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:35:37.105312 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:35:37.105312 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:35:37.105312 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:35:37.105312 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:35:37.105312 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application with Lock( Oct 01 20:35:37.105312 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:35:37.105312 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:35:37.105312 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:35:37.105312 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:35:37.105312 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:35:37.105312 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:35:37.105312 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:35:37.105312 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:35:37.105312 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 20:35:37.106568 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 20:35:37.106568 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:35:37.106568 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:35:37.106568 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 443/886] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Oct 1 20:35:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:35:37.111131 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df502708-956d-4216-ac35-bbaf711ef5a7 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:35:37.188411 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:35:37.214543 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df502708-956d-4216-ac35-bbaf711ef5a7 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:35:37.247847 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560c1a6b-effd-4c45-b497-b479d1b2466f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:35:37.248437 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c1a6b-effd-4c45-b497-b479d1b2466f None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:37.248730 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c1a6b-effd-4c45-b497-b479d1b2466f None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:37.249005 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c1a6b-effd-4c45-b497-b479d1b2466f None admin] PATH_INFO: `/v3/domains` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:37.249638 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560c1a6b-effd-4c45-b497-b479d1b2466f None admin] RBAC: Adding query filter params (name=Default) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:35:37.249940 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560c1a6b-effd-4c45-b497-b479d1b2466f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:35:37.251306 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560c1a6b-effd-4c45-b497-b479d1b2466f None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:35:37.263109 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 444/887] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Oct 1 20:35:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:35:37.268785 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa3777e-359e-43b9-ad91-e970ef4d4546 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:35:37.374035 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa3777e-359e-43b9-ad91-e970ef4d4546 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:35:37.392894 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:35:37.406754 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e062d3-3fcf-47d9-8c4f-04d91b206b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:35:37.407365 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e062d3-3fcf-47d9-8c4f-04d91b206b5c None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:37.407639 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e062d3-3fcf-47d9-8c4f-04d91b206b5c None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:37.407903 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e062d3-3fcf-47d9-8c4f-04d91b206b5c None admin] PATH_INFO: `/v3/users/placement` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:37.415048 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e062d3-3fcf-47d9-8c4f-04d91b206b5c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:35:37.416473 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e062d3-3fcf-47d9-8c4f-04d91b206b5c None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:35:37.427338 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application [None req-b5e062d3-3fcf-47d9-8c4f-04d91b206b5c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 01 20:35:37.427338 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:35:37.427338 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:35:37.427338 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:35:37.427338 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:35:37.427338 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:35:37.427338 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:35:37.427338 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:35:37.427338 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:35:37.427338 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:35:37.427338 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:35:37.427338 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:35:37.427338 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 01 20:35:37.427338 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 01 20:35:37.427338 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 01 20:35:37.427338 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 01 20:35:37.429030 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:35:37.429030 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:35:37.429030 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 01 20:35:37.429030 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 20:35:37.429030 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 01 20:35:37.429030 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 20:35:37.429030 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:35:37.429030 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:35:37.429030 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:35:37.429030 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:35:37.429030 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:35:37.429030 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application with Lock( Oct 01 20:35:37.429030 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:35:37.429030 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:35:37.429030 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:35:37.429030 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:35:37.429030 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:35:37.429030 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:35:37.430430 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:35:37.430430 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:35:37.430430 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 01 20:35:37.430430 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 01 20:35:37.430430 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 01 20:35:37.430430 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 01 20:35:37.430430 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 01 20:35:37.430430 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 01 20:35:37.430430 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 01 20:35:37.430430 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:35:37.430430 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 444/888] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Oct 1 20:35:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:35:37.434807 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560c1a6b-effd-4c45-b497-b479d1b2466f None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:35:37.530867 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560c1a6b-effd-4c45-b497-b479d1b2466f None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:35:37.563304 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91252fb5-e14c-40f4-a64f-a891103a0f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:35:37.563892 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91252fb5-e14c-40f4-a64f-a891103a0f34 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:37.564168 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91252fb5-e14c-40f4-a64f-a891103a0f34 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:37.564437 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91252fb5-e14c-40f4-a64f-a891103a0f34 None admin] PATH_INFO: `/v3/users` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:37.565445 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91252fb5-e14c-40f4-a64f-a891103a0f34 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:35:37.565749 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91252fb5-e14c-40f4-a64f-a891103a0f34 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:35:37.567160 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91252fb5-e14c-40f4-a64f-a891103a0f34 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:35:37.570322 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:35:37.585639 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 445/889] 10.222.0.23 () {56 vars in 1143 bytes} [Sat Oct 1 20:35:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:35:37.591338 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e062d3-3fcf-47d9-8c4f-04d91b206b5c None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:35:37.688657 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e062d3-3fcf-47d9-8c4f-04d91b206b5c None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:35:37.722592 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b9ae7b-d06e-4c15-a847-f9e8162a2a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:35:37.723211 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b9ae7b-d06e-4c15-a847-f9e8162a2a3a None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:37.723491 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b9ae7b-d06e-4c15-a847-f9e8162a2a3a None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:37.723765 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b9ae7b-d06e-4c15-a847-f9e8162a2a3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:37.734087 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b9ae7b-d06e-4c15-a847-f9e8162a2a3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:35:37.735521 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b9ae7b-d06e-4c15-a847-f9e8162a2a3a None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:35:37.749175 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application [None req-42b9ae7b-d06e-4c15-a847-f9e8162a2a3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:35:37.749175 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:35:37.749175 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:35:37.749175 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:35:37.749175 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:35:37.749175 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:35:37.749175 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:35:37.749175 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:35:37.749175 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:35:37.749175 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:35:37.749175 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:35:37.749175 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:35:37.749175 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 20:35:37.749175 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 20:35:37.749175 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 20:35:37.749175 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 20:35:37.750249 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:35:37.750249 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:35:37.750249 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:35:37.750249 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:35:37.750249 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:35:37.750249 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:35:37.750249 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:35:37.750249 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application with Lock( Oct 01 20:35:37.750249 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:35:37.750249 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:35:37.750249 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:35:37.750249 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:35:37.750249 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:35:37.750249 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:35:37.750249 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:35:37.750249 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:35:37.750249 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 20:35:37.751329 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 20:35:37.751329 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:35:37.751329 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:35:37.751329 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 445/890] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Oct 1 20:35:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:35:37.756616 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91252fb5-e14c-40f4-a64f-a891103a0f34 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:35:37.852321 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91252fb5-e14c-40f4-a64f-a891103a0f34 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:35:37.890493 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b307b6c9-2ba2-4ced-ae5d-e5116feb33ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:35:37.891081 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b307b6c9-2ba2-4ced-ae5d-e5116feb33ea None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:37.891353 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b307b6c9-2ba2-4ced-ae5d-e5116feb33ea None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:37.891649 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b307b6c9-2ba2-4ced-ae5d-e5116feb33ea None admin] PATH_INFO: `/v3/domains` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:37.892280 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b307b6c9-2ba2-4ced-ae5d-e5116feb33ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:35:37.892606 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b307b6c9-2ba2-4ced-ae5d-e5116feb33ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:35:37.893954 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b307b6c9-2ba2-4ced-ae5d-e5116feb33ea None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:35:37.904856 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 446/891] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Oct 1 20:35:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:35:37.910618 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b9ae7b-d06e-4c15-a847-f9e8162a2a3a None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:35:37.941549 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:35:38.008267 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b9ae7b-d06e-4c15-a847-f9e8162a2a3a None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:35:38.040041 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e257723-35c4-400e-bc9b-a61b06fc1f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:35:38.040681 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e257723-35c4-400e-bc9b-a61b06fc1f36 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:38.040957 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e257723-35c4-400e-bc9b-a61b06fc1f36 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:38.041221 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e257723-35c4-400e-bc9b-a61b06fc1f36 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:38.047519 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e257723-35c4-400e-bc9b-a61b06fc1f36 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:35:38.048980 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e257723-35c4-400e-bc9b-a61b06fc1f36 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:35:38.060944 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application [None req-6e257723-35c4-400e-bc9b-a61b06fc1f36 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 20:35:38.060944 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:35:38.060944 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:35:38.060944 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:35:38.060944 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:35:38.060944 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:35:38.060944 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:35:38.060944 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:35:38.060944 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:35:38.060944 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:35:38.060944 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:35:38.060944 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:35:38.060944 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 01 20:35:38.060944 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 01 20:35:38.060944 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 01 20:35:38.061992 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 01 20:35:38.061992 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:35:38.061992 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:35:38.061992 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:35:38.061992 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:35:38.061992 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:35:38.061992 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:35:38.061992 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:35:38.061992 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application with Lock( Oct 01 20:35:38.061992 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:35:38.061992 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:35:38.061992 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:35:38.061992 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:35:38.061992 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:35:38.061992 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:35:38.061992 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:35:38.061992 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:35:38.063105 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 01 20:35:38.063105 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 01 20:35:38.063105 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 01 20:35:38.063105 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 01 20:35:38.063105 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 01 20:35:38.063105 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 01 20:35:38.063105 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 20:35:38.063105 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:35:38.063105 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 446/892] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Oct 1 20:35:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:35:38.068253 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b307b6c9-2ba2-4ced-ae5d-e5116feb33ea None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:35:38.122709 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:35:38.165795 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b307b6c9-2ba2-4ced-ae5d-e5116feb33ea None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:35:38.197857 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb5f969-23ee-491f-96aa-8e9a39a3e481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:35:38.198445 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb5f969-23ee-491f-96aa-8e9a39a3e481 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:38.198741 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb5f969-23ee-491f-96aa-8e9a39a3e481 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:38.199009 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb5f969-23ee-491f-96aa-8e9a39a3e481 None admin] PATH_INFO: `/v3/projects` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:38.199704 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb5f969-23ee-491f-96aa-8e9a39a3e481 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:35:38.200005 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb5f969-23ee-491f-96aa-8e9a39a3e481 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:35:38.201450 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb5f969-23ee-491f-96aa-8e9a39a3e481 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:35:38.213511 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 447/893] 10.222.0.23 () {56 vars in 1148 bytes} [Sat Oct 1 20:35:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:35:38.219630 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e257723-35c4-400e-bc9b-a61b06fc1f36 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:35:38.314073 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:35:38.323736 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e257723-35c4-400e-bc9b-a61b06fc1f36 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:35:38.357492 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da5fa0f-be81-4c29-a7b3-ca2338c005b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:35:38.358132 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da5fa0f-be81-4c29-a7b3-ca2338c005b9 None admin] REQUEST_METHOD: `PUT` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:38.358405 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da5fa0f-be81-4c29-a7b3-ca2338c005b9 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:38.358674 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da5fa0f-be81-4c29-a7b3-ca2338c005b9 None admin] PATH_INFO: `/v3/projects/8f242c4eeaa04ed19dcdc8ba95b86cfb/users/645c8f9d14a743c2b1103eec2a07c4e8/roles/d11e7ba2f1fa41ff8ea8dda2a8d1466f` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:38.360549 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da5fa0f-be81-4c29-a7b3-ca2338c005b9 None admin] RBAC: Authorizing `identity:create_grant(project_id=8f242c4eeaa04ed19dcdc8ba95b86cfb, user_id=645c8f9d14a743c2b1103eec2a07c4e8, role_id=d11e7ba2f1fa41ff8ea8dda2a8d1466f)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:35:38.361978 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da5fa0f-be81-4c29-a7b3-ca2338c005b9 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:35:38.374298 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 447/894] 10.222.0.23 () {58 vars in 1439 bytes} [Sat Oct 1 20:35:38 2022] PUT /identity/v3/projects/8f242c4eeaa04ed19dcdc8ba95b86cfb/users/645c8f9d14a743c2b1103eec2a07c4e8/roles/d11e7ba2f1fa41ff8ea8dda2a8d1466f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 20:35:40.736512 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba6c20-6145-4adf-a940-41375d786ecc None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:40.737056 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba6c20-6145-4adf-a940-41375d786ecc None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:40.737056 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba6c20-6145-4adf-a940-41375d786ecc None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:40.738371 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 448/895] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:35:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:35:40.744149 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef508138-9a53-49b1-9230-70a5bfd3f81d None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:40.744558 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef508138-9a53-49b1-9230-70a5bfd3f81d None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:40.744723 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef508138-9a53-49b1-9230-70a5bfd3f81d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:40.762688 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-ef508138-9a53-49b1-9230-70a5bfd3f81d None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:35:40.763893 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-ef508138-9a53-49b1-9230-70a5bfd3f81d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:35:40.828936 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 448/896] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:35:40 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 01 20:35:41.163997 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ba6c20-6145-4adf-a940-41375d786ecc None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:35:41.261153 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ba6c20-6145-4adf-a940-41375d786ecc None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:35:41.274883 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:35:41.294578 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa66f03-ec4a-426d-8f93-da71c83854ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:35:41.295184 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa66f03-ec4a-426d-8f93-da71c83854ba None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:41.295458 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa66f03-ec4a-426d-8f93-da71c83854ba None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:41.295724 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa66f03-ec4a-426d-8f93-da71c83854ba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:41.305632 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa66f03-ec4a-426d-8f93-da71c83854ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 20:35:41.310435 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-0aa66f03-ec4a-426d-8f93-da71c83854ba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 20:35:41.310435 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:35:41.310435 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:35:41.310435 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:35:41.310435 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:35:41.310435 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:35:41.310435 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:35:41.310435 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:35:41.310435 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:35:41.310435 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:35:41.310435 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:35:41.310435 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:35:41.310435 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 20:35:41.310435 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 20:35:41.310435 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 20:35:41.310435 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 20:35:41.311483 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 20:35:41.311483 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 20:35:41.311483 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 20:35:41.311483 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 20:35:41.311483 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:35:41.311483 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:35:41.311483 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:35:41.311483 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:35:41.311483 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:35:41.311483 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:35:41.311483 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:35:41.311483 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:35:41.311483 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:35:41.311483 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:35:41.311483 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:35:41.311483 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:35:41.312506 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:35:41.312506 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:35:41.312506 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:35:41.312506 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:35:41.312506 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 20:35:41.312506 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 20:35:41.312506 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 20:35:41.312506 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 20:35:41.312506 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 20:35:41.312506 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 20:35:41.312506 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 20:35:41.312506 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:35:41.312506 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 449/897] 10.222.0.23 () {56 vars in 1096 bytes} [Sat Oct 1 20:35:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:35:41.317735 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef508138-9a53-49b1-9230-70a5bfd3f81d None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:35:41.404501 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:35:41.422722 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef508138-9a53-49b1-9230-70a5bfd3f81d None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:35:41.456350 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356aa5d5-61bb-47eb-b018-245ec4db72a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:35:41.456981 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356aa5d5-61bb-47eb-b018-245ec4db72a8 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:41.457260 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356aa5d5-61bb-47eb-b018-245ec4db72a8 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:41.457533 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356aa5d5-61bb-47eb-b018-245ec4db72a8 None admin] PATH_INFO: `/v3/roles` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:41.458195 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356aa5d5-61bb-47eb-b018-245ec4db72a8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:35:41.458497 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356aa5d5-61bb-47eb-b018-245ec4db72a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:35:41.460489 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356aa5d5-61bb-47eb-b018-245ec4db72a8 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:35:41.468320 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 449/898] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Oct 1 20:35:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:35:41.474137 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa66f03-ec4a-426d-8f93-da71c83854ba None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:35:41.570201 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa66f03-ec4a-426d-8f93-da71c83854ba None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:35:41.602298 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6b2265-17da-40f3-905e-b083db1905e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:35:41.602896 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b2265-17da-40f3-905e-b083db1905e7 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:41.603167 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b2265-17da-40f3-905e-b083db1905e7 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:41.603430 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b2265-17da-40f3-905e-b083db1905e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:41.613389 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6b2265-17da-40f3-905e-b083db1905e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:35:41.614811 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6b2265-17da-40f3-905e-b083db1905e7 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:35:41.629269 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-9c6b2265-17da-40f3-905e-b083db1905e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:35:41.629269 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:35:41.629269 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:35:41.629269 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:35:41.629269 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:35:41.629269 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:35:41.629269 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:35:41.629269 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:35:41.629269 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:35:41.629269 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:35:41.629269 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:35:41.629269 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:35:41.629269 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 20:35:41.629269 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 20:35:41.629269 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 20:35:41.629269 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 20:35:41.630363 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:35:41.630363 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:35:41.630363 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:35:41.630363 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:35:41.630363 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:35:41.630363 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:35:41.630363 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:35:41.630363 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:35:41.630363 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:35:41.630363 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:35:41.630363 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:35:41.630363 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:35:41.630363 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:35:41.630363 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:35:41.630363 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:35:41.630363 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:35:41.630363 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 20:35:41.631867 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 20:35:41.631867 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:35:41.631867 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:35:41.631867 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 450/899] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Oct 1 20:35:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:35:41.636448 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356aa5d5-61bb-47eb-b018-245ec4db72a8 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:35:41.734425 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356aa5d5-61bb-47eb-b018-245ec4db72a8 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:35:41.767673 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e22875-10b4-4ef3-8dfa-d6ea4046b482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:35:41.768268 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e22875-10b4-4ef3-8dfa-d6ea4046b482 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:41.768543 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e22875-10b4-4ef3-8dfa-d6ea4046b482 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:41.768834 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e22875-10b4-4ef3-8dfa-d6ea4046b482 None admin] PATH_INFO: `/v3/domains` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:41.769464 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e22875-10b4-4ef3-8dfa-d6ea4046b482 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:35:41.769786 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e22875-10b4-4ef3-8dfa-d6ea4046b482 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:35:41.771145 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e22875-10b4-4ef3-8dfa-d6ea4046b482 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:35:41.783013 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 450/900] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Oct 1 20:35:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:35:41.788894 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6b2265-17da-40f3-905e-b083db1905e7 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:35:41.816761 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:35:41.889853 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6b2265-17da-40f3-905e-b083db1905e7 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:35:41.922117 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c39d835-a346-407c-b509-8d1152f774ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:35:41.922729 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c39d835-a346-407c-b509-8d1152f774ed None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:41.923006 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c39d835-a346-407c-b509-8d1152f774ed None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:41.923281 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c39d835-a346-407c-b509-8d1152f774ed None admin] PATH_INFO: `/v3/users/placement` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:41.931387 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c39d835-a346-407c-b509-8d1152f774ed None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:35:41.932835 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c39d835-a346-407c-b509-8d1152f774ed None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:35:41.944889 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-8c39d835-a346-407c-b509-8d1152f774ed None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 01 20:35:41.944889 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:35:41.944889 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:35:41.944889 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:35:41.944889 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:35:41.944889 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:35:41.944889 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:35:41.944889 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:35:41.944889 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:35:41.944889 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:35:41.944889 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:35:41.944889 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:35:41.944889 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 01 20:35:41.944889 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 01 20:35:41.944889 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 01 20:35:41.944889 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 01 20:35:41.945953 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:35:41.945953 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:35:41.945953 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 01 20:35:41.945953 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 20:35:41.945953 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 01 20:35:41.945953 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 20:35:41.945953 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:35:41.945953 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:35:41.945953 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:35:41.945953 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:35:41.945953 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:35:41.945953 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:35:41.945953 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:35:41.945953 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:35:41.945953 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:35:41.945953 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:35:41.945953 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:35:41.945953 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:35:41.947290 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:35:41.947290 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:35:41.947290 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 01 20:35:41.947290 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 01 20:35:41.947290 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 01 20:35:41.947290 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 01 20:35:41.947290 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 01 20:35:41.947290 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 01 20:35:41.947290 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 01 20:35:41.947290 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:35:41.947290 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 451/901] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Oct 1 20:35:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:35:41.951691 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e22875-10b4-4ef3-8dfa-d6ea4046b482 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:35:41.955386 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:35:42.049731 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e22875-10b4-4ef3-8dfa-d6ea4046b482 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:35:42.084335 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0795cfdf-300f-4bb4-905d-bb2be2dd1bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:35:42.084958 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0795cfdf-300f-4bb4-905d-bb2be2dd1bf8 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:42.085235 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0795cfdf-300f-4bb4-905d-bb2be2dd1bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:42.085505 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0795cfdf-300f-4bb4-905d-bb2be2dd1bf8 None admin] PATH_INFO: `/v3/users` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:42.086218 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0795cfdf-300f-4bb4-905d-bb2be2dd1bf8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:35:42.086520 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0795cfdf-300f-4bb4-905d-bb2be2dd1bf8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:35:42.087942 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0795cfdf-300f-4bb4-905d-bb2be2dd1bf8 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:35:42.106443 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 451/902] 10.222.0.23 () {56 vars in 1143 bytes} [Sat Oct 1 20:35:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:35:42.112156 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c39d835-a346-407c-b509-8d1152f774ed None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:35:42.198820 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:35:42.213821 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c39d835-a346-407c-b509-8d1152f774ed None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:35:42.247030 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edd3c03-e202-474b-9795-4f2c9c7a7ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:35:42.247615 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd3c03-e202-474b-9795-4f2c9c7a7ecc None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:42.247892 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd3c03-e202-474b-9795-4f2c9c7a7ecc None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:42.248161 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd3c03-e202-474b-9795-4f2c9c7a7ecc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:42.312743 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edd3c03-e202-474b-9795-4f2c9c7a7ecc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:35:42.314117 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edd3c03-e202-474b-9795-4f2c9c7a7ecc None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:35:42.395899 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:35:42.413265 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 452/903] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Oct 1 20:35:42 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 01 20:35:42.423119 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0795cfdf-300f-4bb4-905d-bb2be2dd1bf8 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:35:42.482897 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:35:42.519313 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0795cfdf-300f-4bb4-905d-bb2be2dd1bf8 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:35:42.552060 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23860e41-0bd2-405a-994c-d49ad1ba8445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:35:42.552795 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23860e41-0bd2-405a-994c-d49ad1ba8445 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:42.553067 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23860e41-0bd2-405a-994c-d49ad1ba8445 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:42.553333 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23860e41-0bd2-405a-994c-d49ad1ba8445 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:42.562980 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23860e41-0bd2-405a-994c-d49ad1ba8445 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:35:42.564344 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23860e41-0bd2-405a-994c-d49ad1ba8445 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:35:42.578433 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application [None req-23860e41-0bd2-405a-994c-d49ad1ba8445 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:35:42.578433 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:35:42.578433 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:35:42.578433 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:35:42.578433 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:35:42.578433 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:35:42.578433 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:35:42.578433 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:35:42.578433 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:35:42.578433 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:35:42.578433 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:35:42.578433 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:35:42.578433 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 20:35:42.578433 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 20:35:42.578433 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 20:35:42.578433 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 20:35:42.579490 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:35:42.579490 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:35:42.579490 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:35:42.579490 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:35:42.579490 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:35:42.579490 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:35:42.579490 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:35:42.579490 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application with Lock( Oct 01 20:35:42.579490 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:35:42.579490 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:35:42.579490 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:35:42.579490 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:35:42.579490 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:35:42.579490 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:35:42.579490 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:35:42.579490 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:35:42.579490 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 20:35:42.580479 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 20:35:42.580479 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 20:35:42.580479 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:35:42.580479 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 452/904] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Oct 1 20:35:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:35:42.585893 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edd3c03-e202-474b-9795-4f2c9c7a7ecc None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:35:42.681040 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edd3c03-e202-474b-9795-4f2c9c7a7ecc None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:35:42.715430 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0141e1e7-2558-4546-8311-9121ff3fd9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:35:42.716015 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141e1e7-2558-4546-8311-9121ff3fd9aa None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:42.716287 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141e1e7-2558-4546-8311-9121ff3fd9aa None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:42.716577 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141e1e7-2558-4546-8311-9121ff3fd9aa None admin] PATH_INFO: `/v3/domains` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:42.717205 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0141e1e7-2558-4546-8311-9121ff3fd9aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:35:42.717500 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0141e1e7-2558-4546-8311-9121ff3fd9aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:35:42.718879 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0141e1e7-2558-4546-8311-9121ff3fd9aa None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:35:42.731042 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 453/905] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Oct 1 20:35:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:35:42.736953 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23860e41-0bd2-405a-994c-d49ad1ba8445 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:35:42.832874 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23860e41-0bd2-405a-994c-d49ad1ba8445 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:35:42.846123 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:35:42.867447 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e23599c-8fec-4e20-b032-c0ee89860899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:35:42.868064 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23599c-8fec-4e20-b032-c0ee89860899 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:42.868356 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23599c-8fec-4e20-b032-c0ee89860899 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:42.868638 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23599c-8fec-4e20-b032-c0ee89860899 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:42.875016 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e23599c-8fec-4e20-b032-c0ee89860899 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:35:42.876455 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e23599c-8fec-4e20-b032-c0ee89860899 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:35:42.887853 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application [None req-4e23599c-8fec-4e20-b032-c0ee89860899 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 20:35:42.887853 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:35:42.887853 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:35:42.887853 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:35:42.887853 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:35:42.887853 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:35:42.887853 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:35:42.887853 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:35:42.887853 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:35:42.887853 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:35:42.887853 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:35:42.887853 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:35:42.887853 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 01 20:35:42.887853 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 01 20:35:42.887853 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 01 20:35:42.888857 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 01 20:35:42.888857 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:35:42.888857 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:35:42.888857 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:35:42.888857 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:35:42.888857 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:35:42.888857 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:35:42.888857 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:35:42.888857 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application with Lock( Oct 01 20:35:42.888857 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:35:42.888857 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:35:42.888857 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:35:42.888857 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:35:42.888857 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:35:42.888857 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:35:42.888857 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:35:42.888857 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:35:42.889779 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 01 20:35:42.889779 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 01 20:35:42.889779 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 01 20:35:42.889779 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 01 20:35:42.889779 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 01 20:35:42.889779 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 01 20:35:42.889779 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 20:35:42.889779 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: ERROR keystone.server.flask.application Oct 01 20:35:42.889779 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 453/906] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Oct 1 20:35:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:35:42.894982 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0141e1e7-2558-4546-8311-9121ff3fd9aa None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:35:42.940496 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:35:42.992207 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0141e1e7-2558-4546-8311-9121ff3fd9aa None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:35:43.024830 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1882b7d3-b3ff-4846-9eb6-a0fc12624ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:35:43.025408 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1882b7d3-b3ff-4846-9eb6-a0fc12624ac4 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:43.025681 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1882b7d3-b3ff-4846-9eb6-a0fc12624ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:43.025946 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1882b7d3-b3ff-4846-9eb6-a0fc12624ac4 None admin] PATH_INFO: `/v3/projects` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:43.026611 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1882b7d3-b3ff-4846-9eb6-a0fc12624ac4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:35:43.026908 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1882b7d3-b3ff-4846-9eb6-a0fc12624ac4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:35:43.028306 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1882b7d3-b3ff-4846-9eb6-a0fc12624ac4 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:35:43.039808 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 454/907] 10.222.0.23 () {56 vars in 1148 bytes} [Sat Oct 1 20:35:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:35:43.045798 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e23599c-8fec-4e20-b032-c0ee89860899 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:35:43.143721 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e23599c-8fec-4e20-b032-c0ee89860899 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:35:43.176068 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cdc20b-7af0-4af6-9c8b-5b5b0ff401eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:35:43.176712 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cdc20b-7af0-4af6-9c8b-5b5b0ff401eb None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:43.176994 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cdc20b-7af0-4af6-9c8b-5b5b0ff401eb None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:43.177266 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cdc20b-7af0-4af6-9c8b-5b5b0ff401eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:43.178494 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cdc20b-7af0-4af6-9c8b-5b5b0ff401eb None admin] RBAC: Adding query filter params (role.id=d11e7ba2f1fa41ff8ea8dda2a8d1466f, scope.project.id=8f242c4eeaa04ed19dcdc8ba95b86cfb, user.id=645c8f9d14a743c2b1103eec2a07c4e8) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:35:43.178801 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cdc20b-7af0-4af6-9c8b-5b5b0ff401eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:35:43.180234 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cdc20b-7af0-4af6-9c8b-5b5b0ff401eb None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:35:43.185878 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 454/908] 10.222.0.23 () {56 vars in 1374 bytes} [Sat Oct 1 20:35:43 2022] GET /identity/v3/role_assignments?user.id=645c8f9d14a743c2b1103eec2a07c4e8&scope.project.id=8f242c4eeaa04ed19dcdc8ba95b86cfb&role.id=d11e7ba2f1fa41ff8ea8dda2a8d1466f => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:35:45.625341 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e37b080-1f95-4217-a219-0737db52f43e None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:45.625877 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e37b080-1f95-4217-a219-0737db52f43e None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:45.625966 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e37b080-1f95-4217-a219-0737db52f43e None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:45.627232 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 455/909] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:35:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:35:45.632373 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a0e3af-3d3a-4f6f-bd37-91b1eaffe043 None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:45.632814 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a0e3af-3d3a-4f6f-bd37-91b1eaffe043 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:45.632936 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a0e3af-3d3a-4f6f-bd37-91b1eaffe043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:45.651264 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-b1a0e3af-3d3a-4f6f-bd37-91b1eaffe043 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:35:45.652432 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-b1a0e3af-3d3a-4f6f-bd37-91b1eaffe043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:35:45.681431 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:35:45.718604 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 455/910] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:35:45 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 01 20:35:46.055599 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e37b080-1f95-4217-a219-0737db52f43e None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:35:46.154357 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e37b080-1f95-4217-a219-0737db52f43e None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:35:46.162318 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:35:46.188211 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2fb499-4095-423a-b28d-f0c2f41a1f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:35:46.188850 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2fb499-4095-423a-b28d-f0c2f41a1f72 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:46.189124 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2fb499-4095-423a-b28d-f0c2f41a1f72 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:46.189649 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2fb499-4095-423a-b28d-f0c2f41a1f72 None admin] PATH_INFO: `/v3/services/placement` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:46.190220 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2fb499-4095-423a-b28d-f0c2f41a1f72 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:35:46.191569 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2fb499-4095-423a-b28d-f0c2f41a1f72 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:35:46.200064 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-9c2fb499-4095-423a-b28d-f0c2f41a1f72 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 01 20:35:46.200064 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:35:46.200064 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 01 20:35:46.200064 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 01 20:35:46.200064 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 01 20:35:46.200064 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 01 20:35:46.200064 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 01 20:35:46.200064 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 01 20:35:46.200064 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 01 20:35:46.200064 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:35:46.200064 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 01 20:35:46.200064 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:35:46.200064 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:35:46.200064 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:35:46.200064 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:35:46.200064 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:35:46.200064 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:35:46.201266 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:35:46.201266 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:35:46.201266 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:35:46.201266 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:35:46.201266 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:35:46.201266 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:35:46.201266 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 01 20:35:46.201266 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 01 20:35:46.201266 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 01 20:35:46.201266 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 01 20:35:46.201266 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:35:46.201266 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:35:46.201266 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:35:46.201266 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:35:46.201266 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:35:46.201266 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:35:46.202173 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:35:46.202173 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:35:46.202173 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:35:46.202173 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:35:46.202173 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:35:46.202173 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:35:46.202173 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:35:46.202173 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:35:46.202173 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:35:46.202173 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:35:46.202173 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 01 20:35:46.202173 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 01 20:35:46.202173 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 01 20:35:46.202173 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:35:46.202173 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 456/911] 10.222.0.23 () {56 vars in 1117 bytes} [Sat Oct 1 20:35:46 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:35:46.207166 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a0e3af-3d3a-4f6f-bd37-91b1eaffe043 None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:35:46.301141 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a0e3af-3d3a-4f6f-bd37-91b1eaffe043 None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:35:46.334742 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc391050-55ba-44a7-aabf-7e32a6c2c3b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:35:46.335268 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc391050-55ba-44a7-aabf-7e32a6c2c3b7 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:46.335546 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc391050-55ba-44a7-aabf-7e32a6c2c3b7 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:46.339543 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc391050-55ba-44a7-aabf-7e32a6c2c3b7 None admin] PATH_INFO: `/v3/services` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:46.339543 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc391050-55ba-44a7-aabf-7e32a6c2c3b7 None admin] RBAC: Adding query filter params (name=placement) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:35:46.339543 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc391050-55ba-44a7-aabf-7e32a6c2c3b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:35:46.339543 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc391050-55ba-44a7-aabf-7e32a6c2c3b7 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:35:46.343496 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 456/912] 10.222.0.23 () {56 vars in 1116 bytes} [Sat Oct 1 20:35:46 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:35:46.351563 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2fb499-4095-423a-b28d-f0c2f41a1f72 None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:35:46.455871 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2fb499-4095-423a-b28d-f0c2f41a1f72 None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:35:46.488427 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9fad96-9d1f-49a8-87b9-507486efa1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:35:46.489039 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9fad96-9d1f-49a8-87b9-507486efa1f2 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:46.489312 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9fad96-9d1f-49a8-87b9-507486efa1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:46.489577 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9fad96-9d1f-49a8-87b9-507486efa1f2 None admin] PATH_INFO: `/v3/services` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:46.490238 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9fad96-9d1f-49a8-87b9-507486efa1f2 None admin] RBAC: Adding query filter params (type=placement) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:35:46.490532 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9fad96-9d1f-49a8-87b9-507486efa1f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:35:46.491876 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9fad96-9d1f-49a8-87b9-507486efa1f2 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:35:46.496048 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 457/913] 10.222.0.23 () {56 vars in 1116 bytes} [Sat Oct 1 20:35:46 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:35:48.864085 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27568ec1-e13d-4f3c-94fd-4d80cff9a847 None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:48.864801 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27568ec1-e13d-4f3c-94fd-4d80cff9a847 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:48.864801 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27568ec1-e13d-4f3c-94fd-4d80cff9a847 None None] PATH_INFO: `/` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:48.866662 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 457/914] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:35:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:35:48.872399 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043ed1f1-28f6-4155-9868-6b030454c500 None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:48.872872 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043ed1f1-28f6-4155-9868-6b030454c500 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:48.872981 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043ed1f1-28f6-4155-9868-6b030454c500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:48.892261 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-043ed1f1-28f6-4155-9868-6b030454c500 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:35:48.893620 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-043ed1f1-28f6-4155-9868-6b030454c500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:35:48.923679 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:35:48.964699 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 458/915] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:35:48 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 01 20:35:49.286231 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27568ec1-e13d-4f3c-94fd-4d80cff9a847 None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:35:49.316785 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:35:49.386108 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27568ec1-e13d-4f3c-94fd-4d80cff9a847 None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:35:49.419154 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0949b1fb-e905-4845-87c2-c4ed960ee494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:35:49.419740 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0949b1fb-e905-4845-87c2-c4ed960ee494 None admin] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:49.420011 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0949b1fb-e905-4845-87c2-c4ed960ee494 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:49.420277 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0949b1fb-e905-4845-87c2-c4ed960ee494 None admin] PATH_INFO: `/v3/services` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:49.420949 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0949b1fb-e905-4845-87c2-c4ed960ee494 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:35:49.422296 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0949b1fb-e905-4845-87c2-c4ed960ee494 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:35:49.436326 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 458/916] 10.222.0.23 () {60 vars in 1141 bytes} [Sat Oct 1 20:35:49 2022] POST /identity/v3/services => generated 246 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 20:35:51.797331 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca879a9-c674-48fc-931a-58ef82a48f03 None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:51.797875 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca879a9-c674-48fc-931a-58ef82a48f03 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:51.797875 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca879a9-c674-48fc-931a-58ef82a48f03 None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:51.799203 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 459/917] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:35:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:35:51.804534 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166df8fe-ee0e-4195-9527-40ec802ca279 None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:51.804959 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166df8fe-ee0e-4195-9527-40ec802ca279 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:51.805094 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166df8fe-ee0e-4195-9527-40ec802ca279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:51.823516 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-166df8fe-ee0e-4195-9527-40ec802ca279 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:35:51.824712 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-166df8fe-ee0e-4195-9527-40ec802ca279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:35:51.898485 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 459/918] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:35:51 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 01 20:35:52.221341 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca879a9-c674-48fc-931a-58ef82a48f03 None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:35:52.318843 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca879a9-c674-48fc-931a-58ef82a48f03 None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:35:52.351643 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a17a223-1747-4367-9b5e-1ede8c6490ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:35:52.352246 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a17a223-1747-4367-9b5e-1ede8c6490ed None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:52.352515 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a17a223-1747-4367-9b5e-1ede8c6490ed None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:52.352808 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a17a223-1747-4367-9b5e-1ede8c6490ed None admin] PATH_INFO: `/v3/services/placement` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:52.353373 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a17a223-1747-4367-9b5e-1ede8c6490ed None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:35:52.354704 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a17a223-1747-4367-9b5e-1ede8c6490ed None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:35:52.363072 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-8a17a223-1747-4367-9b5e-1ede8c6490ed None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 01 20:35:52.363072 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:35:52.363072 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 01 20:35:52.363072 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 01 20:35:52.363072 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 01 20:35:52.363072 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 01 20:35:52.363072 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 01 20:35:52.363072 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 01 20:35:52.363072 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 01 20:35:52.363072 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:35:52.363072 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 01 20:35:52.363072 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:35:52.363072 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:35:52.363072 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:35:52.363072 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:35:52.363072 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:35:52.363072 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:35:52.364296 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:35:52.364296 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:35:52.364296 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:35:52.364296 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:35:52.364296 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:35:52.364296 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:35:52.364296 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 01 20:35:52.364296 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 01 20:35:52.364296 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 01 20:35:52.364296 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 01 20:35:52.364296 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:35:52.364296 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:35:52.364296 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:35:52.364296 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:35:52.364296 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:35:52.364296 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:35:52.365547 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:35:52.365547 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:35:52.365547 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:35:52.365547 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:35:52.365547 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:35:52.365547 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:35:52.365547 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:35:52.365547 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:35:52.365547 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:35:52.365547 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:35:52.365547 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 01 20:35:52.365547 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 01 20:35:52.365547 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 01 20:35:52.365547 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:35:52.365547 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 460/919] 10.222.0.23 () {56 vars in 1117 bytes} [Sat Oct 1 20:35:52 2022] GET /identity/v3/services/placement => generated 90 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:35:52.370189 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166df8fe-ee0e-4195-9527-40ec802ca279 None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:35:52.388131 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:35:52.469103 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166df8fe-ee0e-4195-9527-40ec802ca279 None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:35:52.501943 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f134c4f-4ec1-4f41-a5d0-077874535a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:35:52.502536 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f134c4f-4ec1-4f41-a5d0-077874535a72 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:52.502812 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f134c4f-4ec1-4f41-a5d0-077874535a72 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:52.503080 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f134c4f-4ec1-4f41-a5d0-077874535a72 None admin] PATH_INFO: `/v3/services` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:52.503694 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f134c4f-4ec1-4f41-a5d0-077874535a72 None admin] RBAC: Adding query filter params (name=placement) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:35:52.503991 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f134c4f-4ec1-4f41-a5d0-077874535a72 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:35:52.505922 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f134c4f-4ec1-4f41-a5d0-077874535a72 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:35:52.510774 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 460/920] 10.222.0.23 () {56 vars in 1116 bytes} [Sat Oct 1 20:35:52 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:35:52.516722 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a17a223-1747-4367-9b5e-1ede8c6490ed None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:35:52.544769 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:35:52.613352 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a17a223-1747-4367-9b5e-1ede8c6490ed None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:35:52.645268 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c126a6-178c-4a13-bac7-b526f27ac3b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:35:52.645938 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c126a6-178c-4a13-bac7-b526f27ac3b3 None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:52.646333 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c126a6-178c-4a13-bac7-b526f27ac3b3 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:52.646602 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c126a6-178c-4a13-bac7-b526f27ac3b3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:52.647285 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c126a6-178c-4a13-bac7-b526f27ac3b3 None admin] RBAC: Adding query filter params (interface=public, service_id=d6f6a44a99c846fe985ebd91e38e014d, region_id=RegionOne) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:35:52.647588 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c126a6-178c-4a13-bac7-b526f27ac3b3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:35:52.648960 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c126a6-178c-4a13-bac7-b526f27ac3b3 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:35:52.653659 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 461/921] 10.222.0.23 () {56 vars in 1251 bytes} [Sat Oct 1 20:35:52 2022] GET /identity/v3/endpoints?service_id=d6f6a44a99c846fe985ebd91e38e014d&interface=public®ion_id=RegionOne => generated 194 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:35:52.659203 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f134c4f-4ec1-4f41-a5d0-077874535a72 None admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:35:52.738317 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:35:52.757620 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f134c4f-4ec1-4f41-a5d0-077874535a72 None admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:35:52.791105 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9d7f44-c394-4c8c-bb93-28dc16f610f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:35:52.791697 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d7f44-c394-4c8c-bb93-28dc16f610f1 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:52.791979 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d7f44-c394-4c8c-bb93-28dc16f610f1 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:52.792250 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d7f44-c394-4c8c-bb93-28dc16f610f1 None admin] PATH_INFO: `/v3/services` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:52.792874 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9d7f44-c394-4c8c-bb93-28dc16f610f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:35:52.794243 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9d7f44-c394-4c8c-bb93-28dc16f610f1 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:35:52.800589 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 461/922] 10.222.0.23 () {56 vars in 1087 bytes} [Sat Oct 1 20:35:52 2022] GET /identity/v3/services => generated 1962 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 20:35:55.313267 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c906299-0373-41b6-9341-ece85826cdaa None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:55.313821 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c906299-0373-41b6-9341-ece85826cdaa None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:55.313821 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c906299-0373-41b6-9341-ece85826cdaa None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:55.315419 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 462/923] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:35:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:35:55.321227 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa82187-cd6b-4522-b253-8c77b04715d6 None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:55.321653 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa82187-cd6b-4522-b253-8c77b04715d6 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:55.321810 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa82187-cd6b-4522-b253-8c77b04715d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:55.340088 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-baa82187-cd6b-4522-b253-8c77b04715d6 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:35:55.341297 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-baa82187-cd6b-4522-b253-8c77b04715d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:35:55.408684 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 462/924] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:35:55 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 01 20:35:55.730555 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c906299-0373-41b6-9341-ece85826cdaa None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:35:55.821291 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:35:55.830860 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c906299-0373-41b6-9341-ece85826cdaa None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:35:55.863976 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56e11c0-5007-4f69-b4b0-fd47649df7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:35:55.864656 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56e11c0-5007-4f69-b4b0-fd47649df7df None admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:55.864932 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56e11c0-5007-4f69-b4b0-fd47649df7df None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:55.865203 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56e11c0-5007-4f69-b4b0-fd47649df7df None admin] PATH_INFO: `/v3/services/placement` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:55.865775 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56e11c0-5007-4f69-b4b0-fd47649df7df None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:35:55.867125 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56e11c0-5007-4f69-b4b0-fd47649df7df None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:35:55.875652 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application [None req-c56e11c0-5007-4f69-b4b0-fd47649df7df None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 01 20:35:55.875652 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:35:55.875652 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 01 20:35:55.875652 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 01 20:35:55.875652 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 01 20:35:55.875652 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 01 20:35:55.875652 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 01 20:35:55.875652 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 01 20:35:55.875652 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 01 20:35:55.875652 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:35:55.875652 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 01 20:35:55.875652 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:35:55.875652 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 20:35:55.875652 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 20:35:55.875652 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 20:35:55.875652 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 20:35:55.875652 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 20:35:55.876825 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 20:35:55.876825 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 20:35:55.876825 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 20:35:55.876825 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 20:35:55.876825 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 20:35:55.876825 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 20:35:55.876825 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 01 20:35:55.876825 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 01 20:35:55.876825 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 01 20:35:55.876825 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 01 20:35:55.876825 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 20:35:55.876825 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 20:35:55.876825 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 20:35:55.876825 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 20:35:55.876825 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 20:35:55.876825 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 20:35:55.877700 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 20:35:55.877700 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application with Lock( Oct 01 20:35:55.877700 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 20:35:55.877700 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self._enter() Oct 01 20:35:55.877700 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 20:35:55.877700 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 20:35:55.877700 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 20:35:55.877700 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application return self.creator() Oct 01 20:35:55.877700 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 20:35:55.877700 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application created_value = creator( Oct 01 20:35:55.877700 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 01 20:35:55.877700 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 01 20:35:55.877700 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 01 20:35:55.877700 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: ERROR keystone.server.flask.application Oct 01 20:35:55.877700 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 463/925] 10.222.0.23 () {56 vars in 1117 bytes} [Sat Oct 1 20:35:55 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 20:35:55.883009 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa82187-cd6b-4522-b253-8c77b04715d6 None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:35:55.959704 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:35:55.982324 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa82187-cd6b-4522-b253-8c77b04715d6 None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:35:56.015156 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deec8b7c-cef7-4809-8951-310e31953d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:35:56.015758 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec8b7c-cef7-4809-8951-310e31953d90 None admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:56.016037 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec8b7c-cef7-4809-8951-310e31953d90 None admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:56.016308 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec8b7c-cef7-4809-8951-310e31953d90 None admin] PATH_INFO: `/v3/services` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:56.016966 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deec8b7c-cef7-4809-8951-310e31953d90 None admin] RBAC: Adding query filter params (name=placement) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:35:56.017266 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deec8b7c-cef7-4809-8951-310e31953d90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:35:56.018634 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deec8b7c-cef7-4809-8951-310e31953d90 None admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:35:56.024220 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 463/926] 10.222.0.23 () {56 vars in 1116 bytes} [Sat Oct 1 20:35:55 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:35:56.030088 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56e11c0-5007-4f69-b4b0-fd47649df7df None admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:35:56.126973 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56e11c0-5007-4f69-b4b0-fd47649df7df None admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:35:56.162802 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c1c0b4-65e1-4e1c-8d1c-e402d16b6bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:35:56.163397 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c1c0b4-65e1-4e1c-8d1c-e402d16b6bb2 None admin] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:35:56.163670 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c1c0b4-65e1-4e1c-8d1c-e402d16b6bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:35:56.163937 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c1c0b4-65e1-4e1c-8d1c-e402d16b6bb2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:35:56.164619 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c1c0b4-65e1-4e1c-8d1c-e402d16b6bb2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:35:56.165973 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c1c0b4-65e1-4e1c-8d1c-e402d16b6bb2 None admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:35:56.185843 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 464/927] 10.222.0.23 () {60 vars in 1144 bytes} [Sat Oct 1 20:35:56 2022] POST /identity/v3/endpoints => generated 331 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 20:36:06.021131 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=30 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:36:06.181624 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:36:56.839638 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c11aaa-d2cb-479b-b1ca-00147bad4078 None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:36:56.840207 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c11aaa-d2cb-479b-b1ca-00147bad4078 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:36:56.840207 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c11aaa-d2cb-479b-b1ca-00147bad4078 None None] PATH_INFO: `/` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:36:56.841833 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 464/928] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:36:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:36:56.847687 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56e6dcf-3925-4d63-8034-f66a40ebe0ab None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:36:56.848220 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56e6dcf-3925-4d63-8034-f66a40ebe0ab None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:36:56.848220 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56e6dcf-3925-4d63-8034-f66a40ebe0ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:36:56.883710 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-c56e6dcf-3925-4d63-8034-f66a40ebe0ab None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:36:56.885447 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-c56e6dcf-3925-4d63-8034-f66a40ebe0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:36:56.978066 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 465/929] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:36:56 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:36:57.343486 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072206aa-d7c6-49fc-9a81-649a32310997 None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:36:57.343791 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072206aa-d7c6-49fc-9a81-649a32310997 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:36:57.344131 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072206aa-d7c6-49fc-9a81-649a32310997 None None] PATH_INFO: `/` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:36:57.346180 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 465/930] 10.222.0.23 () {54 vars in 964 bytes} [Sat Oct 1 20:36:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:36:57.352840 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aeb4b3-2634-4d3a-b2ec-e4e8a4cf40c4 None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:36:57.353197 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aeb4b3-2634-4d3a-b2ec-e4e8a4cf40c4 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:36:57.353541 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aeb4b3-2634-4d3a-b2ec-e4e8a4cf40c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:36:57.419583 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-e6aeb4b3-2634-4d3a-b2ec-e4e8a4cf40c4 None None] MFA Rules not processed for user `d498314742474614b90a1350359f506a`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:36:57.420807 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-e6aeb4b3-2634-4d3a-b2ec-e4e8a4cf40c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:36:57.480637 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 466/931] 10.222.0.23 () {58 vars in 1061 bytes} [Sat Oct 1 20:36:57 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:36:57.490289 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072206aa-d7c6-49fc-9a81-649a32310997 None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:36:57.501600 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072206aa-d7c6-49fc-9a81-649a32310997 None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:36:57.505796 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c050dab3-72d9-458a-9e72-233b450b1345 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd498314742474614b90a1350359f506a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f242c4eeaa04ed19dcdc8ba95b86cfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:36:57.506537 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050dab3-72d9-458a-9e72-233b450b1345 service neutron] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:36:57.506881 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050dab3-72d9-458a-9e72-233b450b1345 service neutron] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:36:57.507217 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050dab3-72d9-458a-9e72-233b450b1345 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:36:57.517095 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c050dab3-72d9-458a-9e72-233b450b1345 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:36:57.519488 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c050dab3-72d9-458a-9e72-233b450b1345 service neutron] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:36:57.531027 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 466/932] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Oct 1 20:36:57 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 20:37:00.219721 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ca32f4-1caa-4138-bdd8-c58596642cda None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:37:00.220273 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ca32f4-1caa-4138-bdd8-c58596642cda None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:37:00.220273 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ca32f4-1caa-4138-bdd8-c58596642cda None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:37:00.221953 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 467/933] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:37:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:37:00.227097 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5e93f-f366-4192-9563-e8fdd9b96982 None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:37:00.227523 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5e93f-f366-4192-9563-e8fdd9b96982 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:37:00.227700 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5e93f-f366-4192-9563-e8fdd9b96982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:37:00.247527 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-73c5e93f-f366-4192-9563-e8fdd9b96982 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:37:00.248855 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-73c5e93f-f366-4192-9563-e8fdd9b96982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:37:00.257717 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 467/934] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:37:00 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:37:00.602610 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ca32f4-1caa-4138-bdd8-c58596642cda None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:37:00.614436 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ca32f4-1caa-4138-bdd8-c58596642cda None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:37:00.618089 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c01121-e96a-4965-a177-97a1bd4f550b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd498314742474614b90a1350359f506a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f242c4eeaa04ed19dcdc8ba95b86cfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:37:00.618811 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c01121-e96a-4965-a177-97a1bd4f550b service neutron] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:37:00.619219 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c01121-e96a-4965-a177-97a1bd4f550b service neutron] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:37:00.619587 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c01121-e96a-4965-a177-97a1bd4f550b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:37:00.629512 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c01121-e96a-4965-a177-97a1bd4f550b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:37:00.631055 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c01121-e96a-4965-a177-97a1bd4f550b service neutron] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:37:00.640738 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 468/935] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Oct 1 20:37:00 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 20:37:03.474966 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee6130-8ef8-441a-9a36-41d2b88f80af None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:37:03.475554 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee6130-8ef8-441a-9a36-41d2b88f80af None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:37:03.475926 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee6130-8ef8-441a-9a36-41d2b88f80af None None] PATH_INFO: `/` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:37:03.478867 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 468/936] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:37:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:37:03.484424 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea18f6b-6bca-4048-8449-0fbb2814d83c None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:37:03.484958 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea18f6b-6bca-4048-8449-0fbb2814d83c None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:37:03.485055 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea18f6b-6bca-4048-8449-0fbb2814d83c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:37:03.527331 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-fea18f6b-6bca-4048-8449-0fbb2814d83c None None] MFA Rules not processed for user `b209a483d1084566a09bb6c4ec92134f`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:37:03.528612 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-fea18f6b-6bca-4048-8449-0fbb2814d83c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:37:03.572864 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:37:03.605224 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 469/937] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:37:03 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:37:03.967967 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc0a77-a930-4363-88f0-75f381918e1a None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:37:03.968392 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc0a77-a930-4363-88f0-75f381918e1a None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:37:03.968742 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc0a77-a930-4363-88f0-75f381918e1a None None] PATH_INFO: `/` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:37:03.970339 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 469/938] 10.222.0.23 () {54 vars in 964 bytes} [Sat Oct 1 20:37:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:37:03.976574 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba59f2d-cf7d-4455-9f85-5a6ac7ee7bf8 None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:37:03.976868 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba59f2d-cf7d-4455-9f85-5a6ac7ee7bf8 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:37:03.977148 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba59f2d-cf7d-4455-9f85-5a6ac7ee7bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:37:03.996309 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-6ba59f2d-cf7d-4455-9f85-5a6ac7ee7bf8 None None] MFA Rules not processed for user `d498314742474614b90a1350359f506a`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:37:03.997559 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-6ba59f2d-cf7d-4455-9f85-5a6ac7ee7bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:37:04.004736 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 470/939] 10.222.0.23 () {58 vars in 1061 bytes} [Sat Oct 1 20:37:03 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:37:04.013333 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc0a77-a930-4363-88f0-75f381918e1a None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:37:04.024085 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc0a77-a930-4363-88f0-75f381918e1a None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:37:04.027447 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce38e10f-90a8-444b-a5f8-72035dfa07f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd498314742474614b90a1350359f506a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f242c4eeaa04ed19dcdc8ba95b86cfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:37:04.028020 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce38e10f-90a8-444b-a5f8-72035dfa07f6 service neutron] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:37:04.028288 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce38e10f-90a8-444b-a5f8-72035dfa07f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:37:04.028581 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce38e10f-90a8-444b-a5f8-72035dfa07f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:37:04.037216 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce38e10f-90a8-444b-a5f8-72035dfa07f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:37:04.038618 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce38e10f-90a8-444b-a5f8-72035dfa07f6 service neutron] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:37:04.048073 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 470/940] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Oct 1 20:37:04 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 20:37:07.299299 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc43899-49a9-4cc0-a11b-6afd9591617d None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:37:07.299816 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc43899-49a9-4cc0-a11b-6afd9591617d None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:37:07.299816 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc43899-49a9-4cc0-a11b-6afd9591617d None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:37:07.301282 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 471/941] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:37:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:37:07.306491 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc09a9d-bf59-4cd9-ac91-2cde34118792 None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:37:07.306889 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc09a9d-bf59-4cd9-ac91-2cde34118792 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:37:07.307045 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc09a9d-bf59-4cd9-ac91-2cde34118792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:37:07.326625 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-5bc09a9d-bf59-4cd9-ac91-2cde34118792 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:37:07.327788 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-5bc09a9d-bf59-4cd9-ac91-2cde34118792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:37:07.392233 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 471/942] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:37:07 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:37:07.745723 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc43899-49a9-4cc0-a11b-6afd9591617d None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:37:07.756643 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc43899-49a9-4cc0-a11b-6afd9591617d None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:37:07.760082 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cd9cf8-0434-41e4-a2d3-095968900c4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd498314742474614b90a1350359f506a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f242c4eeaa04ed19dcdc8ba95b86cfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:37:07.760705 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd9cf8-0434-41e4-a2d3-095968900c4b service neutron] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:37:07.760983 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd9cf8-0434-41e4-a2d3-095968900c4b service neutron] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:37:07.761254 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd9cf8-0434-41e4-a2d3-095968900c4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:37:07.769886 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cd9cf8-0434-41e4-a2d3-095968900c4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:37:07.771317 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cd9cf8-0434-41e4-a2d3-095968900c4b service neutron] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:37:07.780539 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 472/943] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Oct 1 20:37:07 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 20:37:10.844257 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95fb88f-d310-4003-9338-83792b2fd3d5 None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:37:10.844892 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95fb88f-d310-4003-9338-83792b2fd3d5 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:37:10.844892 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95fb88f-d310-4003-9338-83792b2fd3d5 None None] PATH_INFO: `/` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:37:10.846857 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 472/944] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:37:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:37:10.852161 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cfe5c1-b40f-4b8a-bf28-f3f737548ae5 None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:37:10.852582 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cfe5c1-b40f-4b8a-bf28-f3f737548ae5 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:37:10.852735 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cfe5c1-b40f-4b8a-bf28-f3f737548ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:37:10.874005 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-e2cfe5c1-b40f-4b8a-bf28-f3f737548ae5 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:37:10.875333 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-e2cfe5c1-b40f-4b8a-bf28-f3f737548ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:37:10.884020 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 473/945] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:37:10 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:37:11.222789 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95fb88f-d310-4003-9338-83792b2fd3d5 None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:37:11.233495 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95fb88f-d310-4003-9338-83792b2fd3d5 None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:37:11.237070 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce0c310-aab9-4cbd-bfa1-d511de9f4d3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd498314742474614b90a1350359f506a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f242c4eeaa04ed19dcdc8ba95b86cfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:37:11.237753 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce0c310-aab9-4cbd-bfa1-d511de9f4d3c service neutron] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:37:11.238104 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce0c310-aab9-4cbd-bfa1-d511de9f4d3c service neutron] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:37:11.238380 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce0c310-aab9-4cbd-bfa1-d511de9f4d3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:37:11.247195 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce0c310-aab9-4cbd-bfa1-d511de9f4d3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:37:11.248654 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce0c310-aab9-4cbd-bfa1-d511de9f4d3c service neutron] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:37:11.258482 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 473/946] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Oct 1 20:37:11 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 20:37:13.786244 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7acf5a-8fd9-4007-90c5-c694e795ba59 None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:37:13.786772 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7acf5a-8fd9-4007-90c5-c694e795ba59 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:37:13.786772 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7acf5a-8fd9-4007-90c5-c694e795ba59 None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:37:13.788140 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 474/947] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:37:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:37:13.793519 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3109774-916b-47d8-8d9e-04e8059755a2 None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:37:13.793956 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3109774-916b-47d8-8d9e-04e8059755a2 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:37:13.794050 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3109774-916b-47d8-8d9e-04e8059755a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:37:13.813167 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-e3109774-916b-47d8-8d9e-04e8059755a2 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:37:13.814854 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-e3109774-916b-47d8-8d9e-04e8059755a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:37:13.822392 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 474/948] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:37:13 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:37:14.153930 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7acf5a-8fd9-4007-90c5-c694e795ba59 None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:37:14.166130 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7acf5a-8fd9-4007-90c5-c694e795ba59 None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:37:14.169596 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0ffe2c-34ad-42cf-9d93-d10cc24932f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd498314742474614b90a1350359f506a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f242c4eeaa04ed19dcdc8ba95b86cfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:37:14.170184 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ffe2c-34ad-42cf-9d93-d10cc24932f4 service neutron] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:37:14.170454 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ffe2c-34ad-42cf-9d93-d10cc24932f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:37:14.170720 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ffe2c-34ad-42cf-9d93-d10cc24932f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:37:14.179861 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0ffe2c-34ad-42cf-9d93-d10cc24932f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:37:14.181287 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0ffe2c-34ad-42cf-9d93-d10cc24932f4 service neutron] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:37:14.190664 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 475/949] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Oct 1 20:37:14 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 20:37:16.657645 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff53142-5fef-47cb-883f-389d74b0a11e None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:37:16.658221 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff53142-5fef-47cb-883f-389d74b0a11e None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:37:16.658221 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff53142-5fef-47cb-883f-389d74b0a11e None None] PATH_INFO: `/` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:37:16.659511 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 475/950] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:37:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:37:16.664998 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7a938-ae93-46ae-b053-22667d144989 None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:37:16.665431 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7a938-ae93-46ae-b053-22667d144989 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:37:16.665542 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7a938-ae93-46ae-b053-22667d144989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:37:16.684707 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-89c7a938-ae93-46ae-b053-22667d144989 None None] MFA Rules not processed for user `b209a483d1084566a09bb6c4ec92134f`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:37:16.685889 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-89c7a938-ae93-46ae-b053-22667d144989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:37:16.698069 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 476/951] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:37:16 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:37:17.035712 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff53142-5fef-47cb-883f-389d74b0a11e None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:37:17.046196 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff53142-5fef-47cb-883f-389d74b0a11e None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:37:17.050182 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e00162-1909-497f-95e4-957a19699897 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd498314742474614b90a1350359f506a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f242c4eeaa04ed19dcdc8ba95b86cfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:37:17.050771 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e00162-1909-497f-95e4-957a19699897 service neutron] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:37:17.051047 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e00162-1909-497f-95e4-957a19699897 service neutron] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:37:17.051319 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e00162-1909-497f-95e4-957a19699897 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:37:17.060075 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e00162-1909-497f-95e4-957a19699897 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:37:17.061531 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e00162-1909-497f-95e4-957a19699897 service neutron] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:37:17.071530 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 476/952] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Oct 1 20:37:17 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 20:37:19.692727 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a1481-f3e8-4944-900c-eaa5eb27b320 None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:37:19.693231 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a1481-f3e8-4944-900c-eaa5eb27b320 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:37:19.693329 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a1481-f3e8-4944-900c-eaa5eb27b320 None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:37:19.694594 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 477/953] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:37:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:37:19.699813 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f48059-9bb7-469a-b99f-86e019b333af None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:37:19.700203 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f48059-9bb7-469a-b99f-86e019b333af None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:37:19.700469 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f48059-9bb7-469a-b99f-86e019b333af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:37:19.719898 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-86f48059-9bb7-469a-b99f-86e019b333af None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:37:19.721177 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-86f48059-9bb7-469a-b99f-86e019b333af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:37:19.728736 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 477/954] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:37:19 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:37:20.066246 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58a1481-f3e8-4944-900c-eaa5eb27b320 None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:37:20.076920 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58a1481-f3e8-4944-900c-eaa5eb27b320 None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:37:20.081165 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e62bc4f-acc5-46a0-af58-6d645e73a8e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd498314742474614b90a1350359f506a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f242c4eeaa04ed19dcdc8ba95b86cfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:37:20.081786 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62bc4f-acc5-46a0-af58-6d645e73a8e2 service neutron] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:37:20.082021 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62bc4f-acc5-46a0-af58-6d645e73a8e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:37:20.082291 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62bc4f-acc5-46a0-af58-6d645e73a8e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:37:20.091311 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e62bc4f-acc5-46a0-af58-6d645e73a8e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:37:20.092772 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e62bc4f-acc5-46a0-af58-6d645e73a8e2 service neutron] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:37:20.102861 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 478/955] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Oct 1 20:37:20 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 20:37:22.606213 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b335003-9602-41dd-8221-001ae76b38f7 None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:37:22.606808 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b335003-9602-41dd-8221-001ae76b38f7 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:37:22.606808 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b335003-9602-41dd-8221-001ae76b38f7 None None] PATH_INFO: `/` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:37:22.608084 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 478/956] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:37:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:37:22.613677 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3533a33-9637-4701-9dc2-98ec144727ed None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:37:22.614116 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3533a33-9637-4701-9dc2-98ec144727ed None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:37:22.614212 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3533a33-9637-4701-9dc2-98ec144727ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:37:22.633614 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-e3533a33-9637-4701-9dc2-98ec144727ed None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:37:22.634807 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-e3533a33-9637-4701-9dc2-98ec144727ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:37:22.643140 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 479/957] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:37:22 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:37:22.988255 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b335003-9602-41dd-8221-001ae76b38f7 None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:37:22.998728 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b335003-9602-41dd-8221-001ae76b38f7 None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:37:23.003002 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d667ad3-10ad-4269-8216-a13bbba96cdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd498314742474614b90a1350359f506a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f242c4eeaa04ed19dcdc8ba95b86cfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:37:23.003583 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d667ad3-10ad-4269-8216-a13bbba96cdc service neutron] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:37:23.003856 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d667ad3-10ad-4269-8216-a13bbba96cdc service neutron] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:37:23.004124 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d667ad3-10ad-4269-8216-a13bbba96cdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:37:23.012764 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d667ad3-10ad-4269-8216-a13bbba96cdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:37:23.014184 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d667ad3-10ad-4269-8216-a13bbba96cdc service neutron] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:37:23.023644 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 479/958] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Oct 1 20:37:22 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 20:37:25.734233 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec508f-4065-4a2f-ba30-4a2057eef677 None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:37:25.734858 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec508f-4065-4a2f-ba30-4a2057eef677 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:37:25.734858 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec508f-4065-4a2f-ba30-4a2057eef677 None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:37:25.737034 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 480/959] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:37:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:37:25.743108 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a8ee2-ef4c-4de6-9670-85d5415a4e59 None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:37:25.743569 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a8ee2-ef4c-4de6-9670-85d5415a4e59 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:37:25.743682 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a8ee2-ef4c-4de6-9670-85d5415a4e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:37:25.762641 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-f29a8ee2-ef4c-4de6-9670-85d5415a4e59 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:37:25.763826 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-f29a8ee2-ef4c-4de6-9670-85d5415a4e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:37:25.771726 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 480/960] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:37:25 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:37:26.115201 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cec508f-4065-4a2f-ba30-4a2057eef677 None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:37:26.127124 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cec508f-4065-4a2f-ba30-4a2057eef677 None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:37:26.130706 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4186312-ddf8-43c3-b699-25687e05af69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd498314742474614b90a1350359f506a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f242c4eeaa04ed19dcdc8ba95b86cfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:37:26.131372 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4186312-ddf8-43c3-b699-25687e05af69 service neutron] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:37:26.131718 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4186312-ddf8-43c3-b699-25687e05af69 service neutron] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:37:26.132053 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4186312-ddf8-43c3-b699-25687e05af69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:37:26.141527 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4186312-ddf8-43c3-b699-25687e05af69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:37:26.143104 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4186312-ddf8-43c3-b699-25687e05af69 service neutron] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:37:26.157203 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 481/961] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Oct 1 20:37:26 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 20:37:30.773834 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7819b4ea-f073-4bda-bd2e-ac7dff6ae14a None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:37:30.774386 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7819b4ea-f073-4bda-bd2e-ac7dff6ae14a None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:37:30.774386 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7819b4ea-f073-4bda-bd2e-ac7dff6ae14a None None] PATH_INFO: `/` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:37:30.775643 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 481/962] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:37:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:37:30.780949 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4eae04-5e8a-406e-8270-650b5329e406 None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:37:30.781360 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4eae04-5e8a-406e-8270-650b5329e406 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:37:30.782288 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4eae04-5e8a-406e-8270-650b5329e406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:37:30.804730 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-8f4eae04-5e8a-406e-8270-650b5329e406 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:37:30.805920 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-8f4eae04-5e8a-406e-8270-650b5329e406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:37:30.813887 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 482/963] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:37:30 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:37:31.159384 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7819b4ea-f073-4bda-bd2e-ac7dff6ae14a None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:37:31.165046 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=74 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:37:31.171541 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7819b4ea-f073-4bda-bd2e-ac7dff6ae14a None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:37:31.175735 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b8e2dd-39c2-4828-80a9-8065e994df2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd498314742474614b90a1350359f506a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f242c4eeaa04ed19dcdc8ba95b86cfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:37:31.176494 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b8e2dd-39c2-4828-80a9-8065e994df2f service neutron] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:37:31.176811 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b8e2dd-39c2-4828-80a9-8065e994df2f service neutron] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:37:31.177081 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b8e2dd-39c2-4828-80a9-8065e994df2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:37:31.186426 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b8e2dd-39c2-4828-80a9-8065e994df2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:37:31.188884 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b8e2dd-39c2-4828-80a9-8065e994df2f service neutron] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:37:31.198404 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 482/964] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Oct 1 20:37:31 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 20:37:34.262718 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89910c3b-2436-42d1-a351-295eeb16578a None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:37:34.263264 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89910c3b-2436-42d1-a351-295eeb16578a None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:37:34.263264 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89910c3b-2436-42d1-a351-295eeb16578a None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:37:34.264625 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 483/965] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:37:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:37:34.270639 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ccc63-7b41-4b74-886b-ca79c40810e7 None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:37:34.271099 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ccc63-7b41-4b74-886b-ca79c40810e7 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:37:34.271315 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ccc63-7b41-4b74-886b-ca79c40810e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:37:34.291017 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-685ccc63-7b41-4b74-886b-ca79c40810e7 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:37:34.292211 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-685ccc63-7b41-4b74-886b-ca79c40810e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:37:34.300091 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 483/966] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:37:34 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:37:34.642221 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89910c3b-2436-42d1-a351-295eeb16578a None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:37:34.653243 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=51 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:37:34.664546 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89910c3b-2436-42d1-a351-295eeb16578a None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:37:34.668079 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f5547e-295a-44fb-9a55-cf31d008886c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd498314742474614b90a1350359f506a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f242c4eeaa04ed19dcdc8ba95b86cfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:37:34.668693 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f5547e-295a-44fb-9a55-cf31d008886c service neutron] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:37:34.668968 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f5547e-295a-44fb-9a55-cf31d008886c service neutron] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:37:34.669232 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f5547e-295a-44fb-9a55-cf31d008886c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:37:34.678806 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f5547e-295a-44fb-9a55-cf31d008886c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:37:34.680398 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f5547e-295a-44fb-9a55-cf31d008886c service neutron] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:37:34.691867 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 484/967] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Oct 1 20:37:34 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 20:37:39.037757 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e06960-4747-484d-aa78-0d7a60845f4d None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:37:39.038331 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e06960-4747-484d-aa78-0d7a60845f4d None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:37:39.038427 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e06960-4747-484d-aa78-0d7a60845f4d None None] PATH_INFO: `/` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:37:39.039793 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 484/968] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:37:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:37:39.045092 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae1d9fe-d633-4cc3-94ce-b241f511d7c5 None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:37:39.045559 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae1d9fe-d633-4cc3-94ce-b241f511d7c5 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:37:39.045650 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae1d9fe-d633-4cc3-94ce-b241f511d7c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:37:39.065221 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-fae1d9fe-d633-4cc3-94ce-b241f511d7c5 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:37:39.066414 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-fae1d9fe-d633-4cc3-94ce-b241f511d7c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:37:39.074169 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 485/969] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:37:39 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:37:39.422404 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e06960-4747-484d-aa78-0d7a60845f4d None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:37:39.433411 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e06960-4747-484d-aa78-0d7a60845f4d None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:37:39.436831 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb313e5-c709-430c-b554-ec9305036989 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd498314742474614b90a1350359f506a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f242c4eeaa04ed19dcdc8ba95b86cfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:37:39.437748 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb313e5-c709-430c-b554-ec9305036989 service neutron] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:37:39.438023 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb313e5-c709-430c-b554-ec9305036989 service neutron] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:37:39.438901 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb313e5-c709-430c-b554-ec9305036989 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:37:39.448018 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb313e5-c709-430c-b554-ec9305036989 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:37:39.449488 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb313e5-c709-430c-b554-ec9305036989 service neutron] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:37:39.459133 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 485/970] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Oct 1 20:37:39 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 20:37:45.002849 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd76d3c-2690-4de5-9fbe-72c5139507b1 None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:37:45.003396 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd76d3c-2690-4de5-9fbe-72c5139507b1 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:37:45.003396 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd76d3c-2690-4de5-9fbe-72c5139507b1 None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:37:45.005429 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 486/971] 10.222.0.23 () {54 vars in 921 bytes} [Sat Oct 1 20:37:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:37:45.010619 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde72c2-6fae-479d-8d69-d1e7733bb41d None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:37:45.011033 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde72c2-6fae-479d-8d69-d1e7733bb41d None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:37:45.011347 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde72c2-6fae-479d-8d69-d1e7733bb41d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:37:45.065281 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-6cde72c2-6fae-479d-8d69-d1e7733bb41d None None] MFA Rules not processed for user `645c8f9d14a743c2b1103eec2a07c4e8`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:37:45.066746 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-6cde72c2-6fae-479d-8d69-d1e7733bb41d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:37:45.151089 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 486/972] 10.222.0.23 () {58 vars in 1018 bytes} [Sat Oct 1 20:37:45 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:37:49.060120 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=8 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:37:49.605036 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c34f0f-bb91-4dbe-ac80-b26437f401c8 None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:37:49.605314 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c34f0f-bb91-4dbe-ac80-b26437f401c8 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:37:49.605585 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c34f0f-bb91-4dbe-ac80-b26437f401c8 None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:37:49.607231 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 487/973] 10.222.0.23 () {54 vars in 921 bytes} [Sat Oct 1 20:37:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:37:49.612849 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be2b14-eaf9-4579-ae23-6cbe4000b89f None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:37:49.613340 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be2b14-eaf9-4579-ae23-6cbe4000b89f None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:37:49.613482 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be2b14-eaf9-4579-ae23-6cbe4000b89f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:37:49.633600 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-02be2b14-eaf9-4579-ae23-6cbe4000b89f None None] MFA Rules not processed for user `645c8f9d14a743c2b1103eec2a07c4e8`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:37:49.634808 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-02be2b14-eaf9-4579-ae23-6cbe4000b89f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:37:49.643415 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 487/974] 10.222.0.23 () {58 vars in 1018 bytes} [Sat Oct 1 20:37:49 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:37:51.321806 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4530f7e-9db3-40ac-b095-6f5c8e9521f9 None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:37:51.322391 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4530f7e-9db3-40ac-b095-6f5c8e9521f9 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:37:51.322391 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4530f7e-9db3-40ac-b095-6f5c8e9521f9 None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:37:51.323658 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 488/975] 10.222.0.23 () {54 vars in 921 bytes} [Sat Oct 1 20:37:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:37:51.329012 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95cc5e6-4620-4926-bbd9-54568513a97e None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:37:51.329433 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95cc5e6-4620-4926-bbd9-54568513a97e None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:37:51.329737 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95cc5e6-4620-4926-bbd9-54568513a97e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:37:51.350970 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-a95cc5e6-4620-4926-bbd9-54568513a97e None None] MFA Rules not processed for user `645c8f9d14a743c2b1103eec2a07c4e8`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:37:51.352243 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-a95cc5e6-4620-4926-bbd9-54568513a97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:37:51.361784 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 488/976] 10.222.0.23 () {58 vars in 1018 bytes} [Sat Oct 1 20:37:51 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:37:55.417981 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03350a-597b-4d2c-9f6e-613e5a03c084 None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:37:55.417981 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03350a-597b-4d2c-9f6e-613e5a03c084 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:37:55.418655 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03350a-597b-4d2c-9f6e-613e5a03c084 None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:37:55.419472 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 489/977] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:37:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:37:55.426198 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49aa594-a431-45d5-bd25-592ad97be0c7 None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:37:55.426639 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49aa594-a431-45d5-bd25-592ad97be0c7 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:37:55.426743 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49aa594-a431-45d5-bd25-592ad97be0c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:37:55.451912 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-e49aa594-a431-45d5-bd25-592ad97be0c7 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:37:55.453175 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-e49aa594-a431-45d5-bd25-592ad97be0c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:37:55.461940 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 489/978] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:37:55 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:37:55.849761 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49714475-e129-4f16-9c8b-873985c2859a None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:37:55.850426 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49714475-e129-4f16-9c8b-873985c2859a None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:37:55.850901 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49714475-e129-4f16-9c8b-873985c2859a None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:37:55.852547 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 490/979] 10.222.0.23 () {54 vars in 961 bytes} [Sat Oct 1 20:37:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:37:55.868846 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad5506-7f0f-4a2e-abb5-600f86b49686 None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:37:55.869571 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad5506-7f0f-4a2e-abb5-600f86b49686 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:37:55.870157 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad5506-7f0f-4a2e-abb5-600f86b49686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:37:55.917456 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-88ad5506-7f0f-4a2e-abb5-600f86b49686 None None] MFA Rules not processed for user `b9c31d26f19d46f09e2f2e5e660234f2`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:37:55.919228 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-88ad5506-7f0f-4a2e-abb5-600f86b49686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:37:55.995980 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:37:56.002693 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 490/980] 10.222.0.23 () {58 vars in 1058 bytes} [Sat Oct 1 20:37:55 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:37:56.011704 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49714475-e129-4f16-9c8b-873985c2859a None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:37:56.027002 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49714475-e129-4f16-9c8b-873985c2859a None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:37:56.033321 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfecc48c-a1d3-4582-83e5-acd558e7bbb4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9c31d26f19d46f09e2f2e5e660234f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f242c4eeaa04ed19dcdc8ba95b86cfb', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:37:56.034089 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfecc48c-a1d3-4582-83e5-acd558e7bbb4 service nova] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:37:56.034468 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfecc48c-a1d3-4582-83e5-acd558e7bbb4 service nova] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:37:56.034840 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfecc48c-a1d3-4582-83e5-acd558e7bbb4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:37:56.045499 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfecc48c-a1d3-4582-83e5-acd558e7bbb4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:37:56.047760 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfecc48c-a1d3-4582-83e5-acd558e7bbb4 service nova] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:37:56.060834 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 491/981] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Oct 1 20:37:56 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 01 20:37:58.731279 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3aa03a-0a7f-4d56-bd92-00e4efd39c3e None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:37:58.731837 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3aa03a-0a7f-4d56-bd92-00e4efd39c3e None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:37:58.731837 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3aa03a-0a7f-4d56-bd92-00e4efd39c3e None None] PATH_INFO: `/` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:37:58.733511 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 491/982] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:37:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:37:58.738817 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1522d0a-2067-4771-bd41-cbfcc597ac68 None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:37:58.739234 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1522d0a-2067-4771-bd41-cbfcc597ac68 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:37:58.739370 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1522d0a-2067-4771-bd41-cbfcc597ac68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:37:58.759994 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-f1522d0a-2067-4771-bd41-cbfcc597ac68 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:37:58.761250 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-f1522d0a-2067-4771-bd41-cbfcc597ac68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:37:58.769497 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 492/983] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:37:58 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:37:59.121212 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3aa03a-0a7f-4d56-bd92-00e4efd39c3e None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:37:59.137308 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3aa03a-0a7f-4d56-bd92-00e4efd39c3e None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:37:59.142861 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301f6030-499a-4855-b99e-18b321bb6be5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9c31d26f19d46f09e2f2e5e660234f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f242c4eeaa04ed19dcdc8ba95b86cfb', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:37:59.143701 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f6030-499a-4855-b99e-18b321bb6be5 service nova] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:37:59.144090 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f6030-499a-4855-b99e-18b321bb6be5 service nova] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:37:59.144473 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f6030-499a-4855-b99e-18b321bb6be5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:37:59.153672 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301f6030-499a-4855-b99e-18b321bb6be5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:37:59.155396 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301f6030-499a-4855-b99e-18b321bb6be5 service nova] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:37:59.167356 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 492/984] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Oct 1 20:37:59 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 20:38:01.940077 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f6352-9442-4ff3-b7e3-1612147a2cc0 None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:38:01.940484 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f6352-9442-4ff3-b7e3-1612147a2cc0 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:38:01.940755 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f6352-9442-4ff3-b7e3-1612147a2cc0 None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:38:01.942885 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 493/985] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:38:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:38:01.947390 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad1800-3527-45f5-b27f-b664f00a1ed2 None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:38:01.947847 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad1800-3527-45f5-b27f-b664f00a1ed2 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:38:01.947936 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad1800-3527-45f5-b27f-b664f00a1ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:38:01.970074 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-34ad1800-3527-45f5-b27f-b664f00a1ed2 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:38:01.972064 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-34ad1800-3527-45f5-b27f-b664f00a1ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:38:01.981480 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 493/986] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:38:01 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:38:02.341585 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87723c6-6bad-4012-aceb-e3d682444e6c None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:38:02.341998 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87723c6-6bad-4012-aceb-e3d682444e6c None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:38:02.342957 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87723c6-6bad-4012-aceb-e3d682444e6c None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:38:02.344381 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 494/987] 10.222.0.23 () {54 vars in 961 bytes} [Sat Oct 1 20:38:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:38:02.354171 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9440d3-2215-439e-8cb3-a13552df9fcf None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:38:02.354616 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9440d3-2215-439e-8cb3-a13552df9fcf None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:38:02.355085 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9440d3-2215-439e-8cb3-a13552df9fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:38:02.377679 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-bb9440d3-2215-439e-8cb3-a13552df9fcf None None] MFA Rules not processed for user `b9c31d26f19d46f09e2f2e5e660234f2`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:38:02.379328 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-bb9440d3-2215-439e-8cb3-a13552df9fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:38:02.393327 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 494/988] 10.222.0.23 () {58 vars in 1058 bytes} [Sat Oct 1 20:38:02 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:38:02.414332 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87723c6-6bad-4012-aceb-e3d682444e6c None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:38:02.444808 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87723c6-6bad-4012-aceb-e3d682444e6c None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:38:02.450157 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd8a90a-e9c4-44c9-a924-6335479d1e72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9c31d26f19d46f09e2f2e5e660234f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f242c4eeaa04ed19dcdc8ba95b86cfb', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:38:02.450881 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8a90a-e9c4-44c9-a924-6335479d1e72 service nova] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:38:02.451255 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8a90a-e9c4-44c9-a924-6335479d1e72 service nova] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:38:02.452483 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8a90a-e9c4-44c9-a924-6335479d1e72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:38:02.466588 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd8a90a-e9c4-44c9-a924-6335479d1e72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:38:02.467624 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd8a90a-e9c4-44c9-a924-6335479d1e72 service nova] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:38:02.479783 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 495/989] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Oct 1 20:38:02 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 20:38:05.097911 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9c483f-7f94-4c3c-9cfb-fc0978499501 None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:38:05.098922 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9c483f-7f94-4c3c-9cfb-fc0978499501 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:38:05.099426 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9c483f-7f94-4c3c-9cfb-fc0978499501 None None] PATH_INFO: `/` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:38:05.106349 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f429ec-0bc5-43e6-ac19-b4f239a15d68 None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:38:05.107328 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f429ec-0bc5-43e6-ac19-b4f239a15d68 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:38:05.108405 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f429ec-0bc5-43e6-ac19-b4f239a15d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:38:05.111573 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 495/990] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:38:05 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:38:05.129852 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-86f429ec-0bc5-43e6-ac19-b4f239a15d68 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:38:05.131450 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-86f429ec-0bc5-43e6-ac19-b4f239a15d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:38:05.152992 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 496/991] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:38:05 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:38:05.536258 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9c483f-7f94-4c3c-9cfb-fc0978499501 None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:38:05.552916 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9c483f-7f94-4c3c-9cfb-fc0978499501 None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:38:05.566161 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1d33cd-b216-4716-aee8-5bf8dce4a820 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9c31d26f19d46f09e2f2e5e660234f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f242c4eeaa04ed19dcdc8ba95b86cfb', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:38:05.567750 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d33cd-b216-4716-aee8-5bf8dce4a820 service nova] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:38:05.568861 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d33cd-b216-4716-aee8-5bf8dce4a820 service nova] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:38:05.569673 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d33cd-b216-4716-aee8-5bf8dce4a820 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:38:05.588593 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1d33cd-b216-4716-aee8-5bf8dce4a820 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:38:05.593353 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1d33cd-b216-4716-aee8-5bf8dce4a820 service nova] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:38:05.618198 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 496/992] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Oct 1 20:38:05 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 20:38:05.677184 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736db1c-c289-45d9-859c-4f2f81d80614 None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:38:05.677473 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736db1c-c289-45d9-859c-4f2f81d80614 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:38:05.679124 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736db1c-c289-45d9-859c-4f2f81d80614 None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:38:05.685040 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 497/993] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:38:05 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:38:05.692179 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c4b02-6775-4565-a98e-054544bca786 None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:38:05.692564 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c4b02-6775-4565-a98e-054544bca786 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:38:05.692984 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c4b02-6775-4565-a98e-054544bca786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:38:05.733752 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-cd1c4b02-6775-4565-a98e-054544bca786 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:38:05.736464 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-cd1c4b02-6775-4565-a98e-054544bca786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:38:05.750801 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 497/994] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:38:05 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:38:06.154789 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6599eb-6034-4653-a75a-c6ea499aff67 None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:38:06.155532 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6599eb-6034-4653-a75a-c6ea499aff67 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:38:06.155697 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6599eb-6034-4653-a75a-c6ea499aff67 None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:38:06.157328 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 498/995] 10.222.0.23 () {54 vars in 963 bytes} [Sat Oct 1 20:38:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:38:06.166062 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c02a5-80c2-414f-92b2-3328d6fae911 None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:38:06.166534 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c02a5-80c2-414f-92b2-3328d6fae911 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:38:06.166656 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c02a5-80c2-414f-92b2-3328d6fae911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:38:06.210184 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-4c4c02a5-80c2-414f-92b2-3328d6fae911 None None] MFA Rules not processed for user `1b737fe6e9f34adf8eef1851a4a89ca6`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:38:06.211392 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-4c4c02a5-80c2-414f-92b2-3328d6fae911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:38:06.278626 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 498/996] 10.222.0.23 () {58 vars in 1060 bytes} [Sat Oct 1 20:38:06 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:38:06.286582 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6599eb-6034-4653-a75a-c6ea499aff67 None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:38:06.297690 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6599eb-6034-4653-a75a-c6ea499aff67 None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:38:06.301262 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258de756-98fb-4999-9b8e-841376496b35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b737fe6e9f34adf8eef1851a4a89ca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f242c4eeaa04ed19dcdc8ba95b86cfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:38:06.301837 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258de756-98fb-4999-9b8e-841376496b35 service cinder] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:38:06.302200 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258de756-98fb-4999-9b8e-841376496b35 service cinder] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:38:06.302469 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258de756-98fb-4999-9b8e-841376496b35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:38:06.312403 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258de756-98fb-4999-9b8e-841376496b35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:38:06.313866 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258de756-98fb-4999-9b8e-841376496b35 service cinder] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:38:06.323868 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 499/997] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Oct 1 20:38:06 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 01 20:38:08.145869 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f4b4af-b215-4266-b613-93b5d754f15e None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:38:08.146467 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f4b4af-b215-4266-b613-93b5d754f15e None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:38:08.146467 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f4b4af-b215-4266-b613-93b5d754f15e None None] PATH_INFO: `/` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:38:08.147784 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 499/998] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:38:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:38:08.153921 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee8d8b-13d4-4580-91ec-6a58589d740a None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:38:08.154456 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee8d8b-13d4-4580-91ec-6a58589d740a None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:38:08.154456 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee8d8b-13d4-4580-91ec-6a58589d740a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:38:08.175871 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-29ee8d8b-13d4-4580-91ec-6a58589d740a None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:38:08.176666 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-29ee8d8b-13d4-4580-91ec-6a58589d740a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:38:08.184655 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 500/999] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:38:08 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:38:08.527931 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f4b4af-b215-4266-b613-93b5d754f15e None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:38:08.542765 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f4b4af-b215-4266-b613-93b5d754f15e None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:38:08.548381 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33d24b5-cdab-4fd4-9799-e3cc7133b600 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9c31d26f19d46f09e2f2e5e660234f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f242c4eeaa04ed19dcdc8ba95b86cfb', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:38:08.549021 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d24b5-cdab-4fd4-9799-e3cc7133b600 service nova] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:38:08.549300 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d24b5-cdab-4fd4-9799-e3cc7133b600 service nova] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:38:08.549570 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d24b5-cdab-4fd4-9799-e3cc7133b600 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:38:08.558434 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33d24b5-cdab-4fd4-9799-e3cc7133b600 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:38:08.560017 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33d24b5-cdab-4fd4-9799-e3cc7133b600 service nova] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:38:08.571260 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 500/1000] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Oct 1 20:38:08 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 20:38:11.059603 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f967b-066a-41f4-9ef7-079f6b2e09d0 None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:38:11.060140 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f967b-066a-41f4-9ef7-079f6b2e09d0 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:38:11.060422 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f967b-066a-41f4-9ef7-079f6b2e09d0 None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:38:11.062656 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 501/1001] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:38:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:38:11.068138 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a665fce-fd9b-43a5-9d33-2056f58086db None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:38:11.068647 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a665fce-fd9b-43a5-9d33-2056f58086db None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:38:11.068892 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a665fce-fd9b-43a5-9d33-2056f58086db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:38:11.091541 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-0a665fce-fd9b-43a5-9d33-2056f58086db None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:38:11.093602 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-0a665fce-fd9b-43a5-9d33-2056f58086db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:38:11.103724 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 501/1002] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:38:11 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:38:11.449794 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5f967b-066a-41f4-9ef7-079f6b2e09d0 None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:38:11.464096 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5f967b-066a-41f4-9ef7-079f6b2e09d0 None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:38:11.469194 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5188423c-3093-421f-adf7-6eb7218916a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9c31d26f19d46f09e2f2e5e660234f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f242c4eeaa04ed19dcdc8ba95b86cfb', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:38:11.469857 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188423c-3093-421f-adf7-6eb7218916a0 service nova] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:38:11.470205 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188423c-3093-421f-adf7-6eb7218916a0 service nova] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:38:11.470546 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188423c-3093-421f-adf7-6eb7218916a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:38:11.478869 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5188423c-3093-421f-adf7-6eb7218916a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:38:11.480504 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5188423c-3093-421f-adf7-6eb7218916a0 service nova] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:38:11.490326 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 502/1003] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Oct 1 20:38:11 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 20:38:14.012164 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f5ee97-8ef9-46bf-9b3b-a99f7b4d3c8a None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:38:14.012780 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f5ee97-8ef9-46bf-9b3b-a99f7b4d3c8a None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:38:14.012780 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f5ee97-8ef9-46bf-9b3b-a99f7b4d3c8a None None] PATH_INFO: `/` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:38:14.014100 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 502/1004] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:38:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:38:14.019954 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d8593-249b-414f-86a6-e1287ae4744e None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:38:14.020588 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d8593-249b-414f-86a6-e1287ae4744e None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:38:14.020588 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d8593-249b-414f-86a6-e1287ae4744e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:38:14.042526 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-ee9d8593-249b-414f-86a6-e1287ae4744e None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:38:14.043817 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-ee9d8593-249b-414f-86a6-e1287ae4744e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:38:14.053455 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 503/1005] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:38:14 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:38:14.409854 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f5ee97-8ef9-46bf-9b3b-a99f7b4d3c8a None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:38:14.429112 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f5ee97-8ef9-46bf-9b3b-a99f7b4d3c8a None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:38:14.437743 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52201e77-c00e-4d19-8cbc-c442c603ad81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9c31d26f19d46f09e2f2e5e660234f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f242c4eeaa04ed19dcdc8ba95b86cfb', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:38:14.438661 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52201e77-c00e-4d19-8cbc-c442c603ad81 service nova] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:38:14.439050 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52201e77-c00e-4d19-8cbc-c442c603ad81 service nova] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:38:14.439698 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52201e77-c00e-4d19-8cbc-c442c603ad81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:38:14.454058 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52201e77-c00e-4d19-8cbc-c442c603ad81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:38:14.457510 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52201e77-c00e-4d19-8cbc-c442c603ad81 service nova] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:38:14.476987 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 503/1006] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Oct 1 20:38:14 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 20:38:17.170715 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b03a88-e4f4-422a-93e0-c649ebae2d5a None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:38:17.171406 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b03a88-e4f4-422a-93e0-c649ebae2d5a None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:38:17.171406 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b03a88-e4f4-422a-93e0-c649ebae2d5a None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:38:17.172761 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 504/1007] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:38:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 01 20:38:17.178705 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86032060-9835-46b6-94ec-4f9a3d62d658 None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:38:17.179204 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86032060-9835-46b6-94ec-4f9a3d62d658 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:38:17.179312 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86032060-9835-46b6-94ec-4f9a3d62d658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:38:17.200306 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-86032060-9835-46b6-94ec-4f9a3d62d658 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:38:17.202095 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-86032060-9835-46b6-94ec-4f9a3d62d658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:38:17.210212 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 504/1008] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:38:17 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:38:17.562232 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b03a88-e4f4-422a-93e0-c649ebae2d5a None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:38:17.576993 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b03a88-e4f4-422a-93e0-c649ebae2d5a None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:38:17.582166 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233c9ac1-afcb-4c01-aff0-74110f5c5e6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9c31d26f19d46f09e2f2e5e660234f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f242c4eeaa04ed19dcdc8ba95b86cfb', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:38:17.582797 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c9ac1-afcb-4c01-aff0-74110f5c5e6e service nova] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:38:17.583069 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c9ac1-afcb-4c01-aff0-74110f5c5e6e service nova] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:38:17.583336 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c9ac1-afcb-4c01-aff0-74110f5c5e6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:38:17.592498 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233c9ac1-afcb-4c01-aff0-74110f5c5e6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:38:17.594104 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233c9ac1-afcb-4c01-aff0-74110f5c5e6e service nova] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:38:17.603828 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 505/1009] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Oct 1 20:38:17 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 20:38:20.806902 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b989a-7ff4-4898-bdfa-3610e0e81c3c None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:38:20.807908 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b989a-7ff4-4898-bdfa-3610e0e81c3c None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:38:20.807908 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b989a-7ff4-4898-bdfa-3610e0e81c3c None None] PATH_INFO: `/` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:38:20.808963 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 505/1010] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:38:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:38:20.815032 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f212957-e687-40b2-b558-99dce13615a1 None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:38:20.815563 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f212957-e687-40b2-b558-99dce13615a1 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:38:20.815563 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f212957-e687-40b2-b558-99dce13615a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:38:20.823274 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=43 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:38:20.836805 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-1f212957-e687-40b2-b558-99dce13615a1 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:38:20.837998 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-1f212957-e687-40b2-b558-99dce13615a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:38:20.846489 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 506/1011] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:38:20 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:38:21.195525 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045b989a-7ff4-4898-bdfa-3610e0e81c3c None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:38:21.209369 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045b989a-7ff4-4898-bdfa-3610e0e81c3c None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:38:21.214231 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab1540f-bb27-46db-8b32-322c6ed3ce4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9c31d26f19d46f09e2f2e5e660234f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f242c4eeaa04ed19dcdc8ba95b86cfb', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:38:21.214843 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab1540f-bb27-46db-8b32-322c6ed3ce4e service nova] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:38:21.215121 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab1540f-bb27-46db-8b32-322c6ed3ce4e service nova] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:38:21.215393 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab1540f-bb27-46db-8b32-322c6ed3ce4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:38:21.223432 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab1540f-bb27-46db-8b32-322c6ed3ce4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:38:21.225039 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab1540f-bb27-46db-8b32-322c6ed3ce4e service nova] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:38:21.234141 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 506/1012] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Oct 1 20:38:21 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 20:38:22.726139 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f12f6a8-4b60-404a-a828-8acb1c051afd None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:38:22.726766 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f12f6a8-4b60-404a-a828-8acb1c051afd None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:38:22.726766 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f12f6a8-4b60-404a-a828-8acb1c051afd None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:38:22.728008 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 507/1013] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:38:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:38:22.733821 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cbd89c-7a2d-4ad8-b60f-24f48e84c0d0 None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:38:22.734283 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cbd89c-7a2d-4ad8-b60f-24f48e84c0d0 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:38:22.734393 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cbd89c-7a2d-4ad8-b60f-24f48e84c0d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:38:22.753609 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-13cbd89c-7a2d-4ad8-b60f-24f48e84c0d0 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:38:22.754779 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-13cbd89c-7a2d-4ad8-b60f-24f48e84c0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:38:22.762311 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 507/1014] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:38:22 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:38:23.113524 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6b1821-b3c1-448a-9dee-7c4c238b8591 None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:38:23.113905 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6b1821-b3c1-448a-9dee-7c4c238b8591 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:38:23.114254 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6b1821-b3c1-448a-9dee-7c4c238b8591 None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:38:23.115798 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 508/1015] 10.222.0.23 () {54 vars in 962 bytes} [Sat Oct 1 20:38:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:38:23.121088 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04543d-d595-44d2-a9a3-526788e2d9e5 None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:38:23.121373 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04543d-d595-44d2-a9a3-526788e2d9e5 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:38:23.121649 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04543d-d595-44d2-a9a3-526788e2d9e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:38:23.160584 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-ca04543d-d595-44d2-a9a3-526788e2d9e5 None None] MFA Rules not processed for user `4029dd2379eb4f5aab7c129a94d29b0c`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:38:23.161776 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-ca04543d-d595-44d2-a9a3-526788e2d9e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:38:23.187255 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=100 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:38:23.233239 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 508/1016] 10.222.0.23 () {58 vars in 1059 bytes} [Sat Oct 1 20:38:23 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:38:23.241599 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6b1821-b3c1-448a-9dee-7c4c238b8591 None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:38:23.253170 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6b1821-b3c1-448a-9dee-7c4c238b8591 None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:38:23.256745 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0820aa99-ab31-415f-aa98-224cac6065d7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4029dd2379eb4f5aab7c129a94d29b0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f242c4eeaa04ed19dcdc8ba95b86cfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:38:23.257412 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0820aa99-ab31-415f-aa98-224cac6065d7 service glance] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:38:23.257758 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0820aa99-ab31-415f-aa98-224cac6065d7 service glance] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:38:23.258113 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0820aa99-ab31-415f-aa98-224cac6065d7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:38:23.267808 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0820aa99-ab31-415f-aa98-224cac6065d7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:38:23.269274 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0820aa99-ab31-415f-aa98-224cac6065d7 service glance] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:38:23.278616 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 509/1017] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Oct 1 20:38:23 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 20:38:23.651520 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d14587-00c1-4c48-b486-9105967c682e None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:38:23.651823 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d14587-00c1-4c48-b486-9105967c682e None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:38:23.652122 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d14587-00c1-4c48-b486-9105967c682e None None] PATH_INFO: `/` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:38:23.653492 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 509/1018] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:38:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:38:23.659433 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af090e-7fc0-451a-8eb6-b1952c5f6f1f None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:38:23.659720 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af090e-7fc0-451a-8eb6-b1952c5f6f1f None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:38:23.659992 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af090e-7fc0-451a-8eb6-b1952c5f6f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:38:23.680112 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-67af090e-7fc0-451a-8eb6-b1952c5f6f1f None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:38:23.681325 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-67af090e-7fc0-451a-8eb6-b1952c5f6f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:38:23.689843 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 510/1019] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:38:23 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:38:24.036048 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d14587-00c1-4c48-b486-9105967c682e None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:38:24.051012 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d14587-00c1-4c48-b486-9105967c682e None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:38:24.056123 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd615b5-949d-4a0b-858c-43f0d192e0e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9c31d26f19d46f09e2f2e5e660234f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f242c4eeaa04ed19dcdc8ba95b86cfb', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:38:24.056826 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd615b5-949d-4a0b-858c-43f0d192e0e4 service nova] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:38:24.057160 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd615b5-949d-4a0b-858c-43f0d192e0e4 service nova] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:38:24.057499 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd615b5-949d-4a0b-858c-43f0d192e0e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:38:24.066669 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd615b5-949d-4a0b-858c-43f0d192e0e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:38:24.068269 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd615b5-949d-4a0b-858c-43f0d192e0e4 service nova] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:38:24.080598 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 510/1020] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Oct 1 20:38:24 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 20:38:26.620565 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707bc97a-36c3-4c58-b630-907e3ad3b9e8 None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:38:26.620565 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707bc97a-36c3-4c58-b630-907e3ad3b9e8 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:38:26.620565 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707bc97a-36c3-4c58-b630-907e3ad3b9e8 None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:38:26.624903 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 511/1021] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:38:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:38:26.627472 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0964da-1c8f-4945-a848-3e5d47c4f6ed None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:38:26.627984 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0964da-1c8f-4945-a848-3e5d47c4f6ed None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:38:26.628149 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0964da-1c8f-4945-a848-3e5d47c4f6ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:38:26.653084 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-da0964da-1c8f-4945-a848-3e5d47c4f6ed None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:38:26.654910 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-da0964da-1c8f-4945-a848-3e5d47c4f6ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:38:26.662937 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 511/1022] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:38:26 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:38:27.009440 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707bc97a-36c3-4c58-b630-907e3ad3b9e8 None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:38:27.023368 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707bc97a-36c3-4c58-b630-907e3ad3b9e8 None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:38:27.035710 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6451126f-b6ec-428e-8344-ef55f8b88f33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9c31d26f19d46f09e2f2e5e660234f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f242c4eeaa04ed19dcdc8ba95b86cfb', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:38:27.036321 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6451126f-b6ec-428e-8344-ef55f8b88f33 service nova] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:38:27.036619 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6451126f-b6ec-428e-8344-ef55f8b88f33 service nova] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:38:27.036889 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6451126f-b6ec-428e-8344-ef55f8b88f33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:38:27.046383 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6451126f-b6ec-428e-8344-ef55f8b88f33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:38:27.048065 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6451126f-b6ec-428e-8344-ef55f8b88f33 service nova] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:38:27.061151 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 512/1023] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Oct 1 20:38:27 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 20:38:29.713567 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db5780-6dc6-4af6-9f59-4f08d6674d83 None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:38:29.714156 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db5780-6dc6-4af6-9f59-4f08d6674d83 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:38:29.714156 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db5780-6dc6-4af6-9f59-4f08d6674d83 None None] PATH_INFO: `/` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:38:29.715472 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 512/1024] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:38:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:38:29.722303 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a778434-fca3-425a-ac5c-4bcd41badffa None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:38:29.722920 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a778434-fca3-425a-ac5c-4bcd41badffa None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:38:29.723199 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a778434-fca3-425a-ac5c-4bcd41badffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:38:29.757229 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-4a778434-fca3-425a-ac5c-4bcd41badffa None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:38:29.764928 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-4a778434-fca3-425a-ac5c-4bcd41badffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:38:29.772841 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 513/1025] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:38:29 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:38:30.130120 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35db5780-6dc6-4af6-9f59-4f08d6674d83 None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:38:30.144212 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35db5780-6dc6-4af6-9f59-4f08d6674d83 None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:38:30.149212 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9e3b0c-a098-4b24-8186-3527895e0e62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9c31d26f19d46f09e2f2e5e660234f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f242c4eeaa04ed19dcdc8ba95b86cfb', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:38:30.149911 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e3b0c-a098-4b24-8186-3527895e0e62 service nova] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:38:30.150247 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e3b0c-a098-4b24-8186-3527895e0e62 service nova] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:38:30.150518 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e3b0c-a098-4b24-8186-3527895e0e62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:38:30.159401 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9e3b0c-a098-4b24-8186-3527895e0e62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:38:30.161030 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9e3b0c-a098-4b24-8186-3527895e0e62 service nova] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:38:30.171113 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 513/1026] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Oct 1 20:38:30 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 20:38:38.611660 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af7617-faef-4860-819b-ee684b3103fe None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:38:38.612269 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af7617-faef-4860-819b-ee684b3103fe None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:38:38.612269 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af7617-faef-4860-819b-ee684b3103fe None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:38:38.613556 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 514/1027] 10.222.0.23 () {54 vars in 918 bytes} [Sat Oct 1 20:38:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:38:38.618564 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feec442-b861-4263-aac9-fe620b6a99f8 None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:38:38.619000 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feec442-b861-4263-aac9-fe620b6a99f8 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:38:38.619112 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feec442-b861-4263-aac9-fe620b6a99f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:38:38.639018 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-5feec442-b861-4263-aac9-fe620b6a99f8 None None] MFA Rules not processed for user `645c8f9d14a743c2b1103eec2a07c4e8`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:38:38.640206 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-5feec442-b861-4263-aac9-fe620b6a99f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:38:38.648477 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 514/1028] 10.222.0.23 () {58 vars in 1015 bytes} [Sat Oct 1 20:38:38 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:38:38.662984 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6106e63-cad4-4b09-ac0e-157e5204c77c None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:38:38.663265 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6106e63-cad4-4b09-ac0e-157e5204c77c None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:38:38.663536 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6106e63-cad4-4b09-ac0e-157e5204c77c None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:38:38.664850 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 515/1029] 10.222.0.23 () {54 vars in 918 bytes} [Sat Oct 1 20:38:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:38:38.669403 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c5a74d-ca78-47f9-8a19-e13edc506b60 None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:38:38.669695 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c5a74d-ca78-47f9-8a19-e13edc506b60 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:38:38.669972 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c5a74d-ca78-47f9-8a19-e13edc506b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:38:38.689079 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-48c5a74d-ca78-47f9-8a19-e13edc506b60 None None] MFA Rules not processed for user `b9c31d26f19d46f09e2f2e5e660234f2`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:38:38.690254 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-48c5a74d-ca78-47f9-8a19-e13edc506b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:38:38.698538 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 515/1030] 10.222.0.23 () {58 vars in 1015 bytes} [Sat Oct 1 20:38:38 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:38:39.750007 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=20 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:38:41.515928 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e1a764-15f9-4221-82b5-ec059295ef58 None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:38:41.516616 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e1a764-15f9-4221-82b5-ec059295ef58 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:38:41.516616 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e1a764-15f9-4221-82b5-ec059295ef58 None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:38:41.517826 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 516/1031] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 1 20:38:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:38:41.523122 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7966431e-60f7-41f2-b802-6e0237667e78 None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:38:41.523519 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7966431e-60f7-41f2-b802-6e0237667e78 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:38:41.523659 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7966431e-60f7-41f2-b802-6e0237667e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:38:41.543219 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-7966431e-60f7-41f2-b802-6e0237667e78 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:38:41.545155 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-7966431e-60f7-41f2-b802-6e0237667e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:38:41.552665 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 516/1032] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 1 20:38:41 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:38:41.896377 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e1a764-15f9-4221-82b5-ec059295ef58 None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:38:41.910745 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e1a764-15f9-4221-82b5-ec059295ef58 None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:38:41.915782 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722ca665-884d-421f-b99e-ba9b74a5d22c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9c31d26f19d46f09e2f2e5e660234f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f242c4eeaa04ed19dcdc8ba95b86cfb', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:38:41.916375 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ca665-884d-421f-b99e-ba9b74a5d22c service nova] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:38:41.916699 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ca665-884d-421f-b99e-ba9b74a5d22c service nova] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:38:41.916970 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ca665-884d-421f-b99e-ba9b74a5d22c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:38:41.925035 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722ca665-884d-421f-b99e-ba9b74a5d22c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:38:41.926610 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722ca665-884d-421f-b99e-ba9b74a5d22c service nova] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:38:41.935814 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 517/1033] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Oct 1 20:38:41 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 20:38:43.610925 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8397cd5a-6ad1-47b8-90ee-16c4a9f6ccb4 None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:38:43.611469 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8397cd5a-6ad1-47b8-90ee-16c4a9f6ccb4 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:38:43.611469 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8397cd5a-6ad1-47b8-90ee-16c4a9f6ccb4 None None] PATH_INFO: `/` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:38:43.613001 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 517/1034] 127.0.0.1 () {54 vars in 901 bytes} [Sat Oct 1 20:38:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:38:43.617949 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e62037a-aebe-441a-95fa-264b6d865d7f None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:38:43.618377 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e62037a-aebe-441a-95fa-264b6d865d7f None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:38:43.618501 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e62037a-aebe-441a-95fa-264b6d865d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:38:43.639657 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-8e62037a-aebe-441a-95fa-264b6d865d7f None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:38:43.640911 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-8e62037a-aebe-441a-95fa-264b6d865d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:38:43.648720 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 518/1035] 127.0.0.1 () {58 vars in 998 bytes} [Sat Oct 1 20:38:43 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:38:43.831259 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8397cd5a-6ad1-47b8-90ee-16c4a9f6ccb4 None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:38:43.844914 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8397cd5a-6ad1-47b8-90ee-16c4a9f6ccb4 None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:38:43.849658 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4293d3-7b7e-43f4-8cfa-bc9950bd8e2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9c31d26f19d46f09e2f2e5e660234f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f242c4eeaa04ed19dcdc8ba95b86cfb', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:38:43.850238 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4293d3-7b7e-43f4-8cfa-bc9950bd8e2b service nova] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:38:43.850511 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4293d3-7b7e-43f4-8cfa-bc9950bd8e2b service nova] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:38:43.850778 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4293d3-7b7e-43f4-8cfa-bc9950bd8e2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:38:43.860231 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4293d3-7b7e-43f4-8cfa-bc9950bd8e2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:38:43.861973 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4293d3-7b7e-43f4-8cfa-bc9950bd8e2b service nova] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:38:43.871201 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 518/1036] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Oct 1 20:38:43 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 20:38:45.582194 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b85782-4d06-4e53-aa0b-c5e585feffa5 None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:38:45.582771 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b85782-4d06-4e53-aa0b-c5e585feffa5 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:38:45.582771 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b85782-4d06-4e53-aa0b-c5e585feffa5 None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:38:45.584056 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 519/1037] 127.0.0.1 () {54 vars in 901 bytes} [Sat Oct 1 20:38:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:38:45.588789 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c229c84d-60d2-4d52-9cf1-97e281113564 None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:38:45.589237 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c229c84d-60d2-4d52-9cf1-97e281113564 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:38:45.589352 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c229c84d-60d2-4d52-9cf1-97e281113564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:38:45.609098 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-c229c84d-60d2-4d52-9cf1-97e281113564 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:38:45.610276 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-c229c84d-60d2-4d52-9cf1-97e281113564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:38:45.617779 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 519/1038] 127.0.0.1 () {58 vars in 998 bytes} [Sat Oct 1 20:38:45 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:38:45.778612 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b85782-4d06-4e53-aa0b-c5e585feffa5 None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:38:45.791756 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b85782-4d06-4e53-aa0b-c5e585feffa5 None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:38:45.796698 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f2aad3-f9ea-4d4c-af08-689703fc03c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9c31d26f19d46f09e2f2e5e660234f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f242c4eeaa04ed19dcdc8ba95b86cfb', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:38:45.797277 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f2aad3-f9ea-4d4c-af08-689703fc03c6 service nova] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:38:45.797546 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f2aad3-f9ea-4d4c-af08-689703fc03c6 service nova] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:38:45.797807 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f2aad3-f9ea-4d4c-af08-689703fc03c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:38:45.805622 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f2aad3-f9ea-4d4c-af08-689703fc03c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:38:45.807174 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f2aad3-f9ea-4d4c-af08-689703fc03c6 service nova] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:38:45.817094 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 520/1039] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Oct 1 20:38:45 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 20:38:47.515310 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79880f2e-3474-4c69-a3c4-9fe02c3d3e88 None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:38:47.515872 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79880f2e-3474-4c69-a3c4-9fe02c3d3e88 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:38:47.515872 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79880f2e-3474-4c69-a3c4-9fe02c3d3e88 None None] PATH_INFO: `/` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:38:47.517213 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 520/1040] 127.0.0.1 () {54 vars in 901 bytes} [Sat Oct 1 20:38:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:38:47.521989 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab941e-d358-4968-bc41-89163b15887a None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:38:47.522374 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab941e-d358-4968-bc41-89163b15887a None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:38:47.522531 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab941e-d358-4968-bc41-89163b15887a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:38:47.541905 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-bbab941e-d358-4968-bc41-89163b15887a None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:38:47.543267 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-bbab941e-d358-4968-bc41-89163b15887a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:38:47.552296 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 521/1041] 127.0.0.1 () {58 vars in 998 bytes} [Sat Oct 1 20:38:47 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:38:47.707151 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79880f2e-3474-4c69-a3c4-9fe02c3d3e88 None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:38:47.721066 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79880f2e-3474-4c69-a3c4-9fe02c3d3e88 None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:38:47.726050 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5048c915-f58c-4cba-b423-5e9c6e8915cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9c31d26f19d46f09e2f2e5e660234f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f242c4eeaa04ed19dcdc8ba95b86cfb', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:38:47.726645 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5048c915-f58c-4cba-b423-5e9c6e8915cc service nova] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:38:47.726923 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5048c915-f58c-4cba-b423-5e9c6e8915cc service nova] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:38:47.727201 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5048c915-f58c-4cba-b423-5e9c6e8915cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:38:47.735378 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5048c915-f58c-4cba-b423-5e9c6e8915cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:38:47.736993 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5048c915-f58c-4cba-b423-5e9c6e8915cc service nova] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:38:47.746064 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 521/1042] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Oct 1 20:38:47 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 20:38:49.443993 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6088a2-a331-4d08-9482-49c702417e21 None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:38:49.444552 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6088a2-a331-4d08-9482-49c702417e21 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:38:49.444552 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6088a2-a331-4d08-9482-49c702417e21 None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:38:49.445791 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 522/1043] 127.0.0.1 () {54 vars in 901 bytes} [Sat Oct 1 20:38:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:38:49.450990 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ca0ea-2dff-45f9-ad18-5c0483083ba1 None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:38:49.451424 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ca0ea-2dff-45f9-ad18-5c0483083ba1 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:38:49.451529 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ca0ea-2dff-45f9-ad18-5c0483083ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:38:49.471678 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-749ca0ea-2dff-45f9-ad18-5c0483083ba1 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:38:49.472904 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-749ca0ea-2dff-45f9-ad18-5c0483083ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:38:49.480617 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 522/1044] 127.0.0.1 () {58 vars in 998 bytes} [Sat Oct 1 20:38:49 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:38:49.637387 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6088a2-a331-4d08-9482-49c702417e21 None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:38:49.650837 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6088a2-a331-4d08-9482-49c702417e21 None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:38:49.655813 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5bee5f-0a36-464f-96ed-df07cbf70e04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9c31d26f19d46f09e2f2e5e660234f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f242c4eeaa04ed19dcdc8ba95b86cfb', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:38:49.656394 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5bee5f-0a36-464f-96ed-df07cbf70e04 service nova] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:38:49.656702 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5bee5f-0a36-464f-96ed-df07cbf70e04 service nova] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:38:49.656978 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5bee5f-0a36-464f-96ed-df07cbf70e04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:38:49.664835 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5bee5f-0a36-464f-96ed-df07cbf70e04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:38:49.666381 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5bee5f-0a36-464f-96ed-df07cbf70e04 service nova] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:38:49.675376 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 523/1045] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Oct 1 20:38:49 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 20:38:51.278192 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad328f01-c527-4e53-93ad-464cd810b5fe None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:38:51.278781 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad328f01-c527-4e53-93ad-464cd810b5fe None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:38:51.278781 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad328f01-c527-4e53-93ad-464cd810b5fe None None] PATH_INFO: `/` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:38:51.280136 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 523/1046] 127.0.0.1 () {54 vars in 901 bytes} [Sat Oct 1 20:38:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:38:51.284967 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09584a9-528b-4fa5-b4f0-ad59901cdcdc None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:38:51.285420 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09584a9-528b-4fa5-b4f0-ad59901cdcdc None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:38:51.285524 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09584a9-528b-4fa5-b4f0-ad59901cdcdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:38:51.304495 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-f09584a9-528b-4fa5-b4f0-ad59901cdcdc None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:38:51.305742 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-f09584a9-528b-4fa5-b4f0-ad59901cdcdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:38:51.314397 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 524/1047] 127.0.0.1 () {58 vars in 998 bytes} [Sat Oct 1 20:38:51 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:38:51.481441 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad328f01-c527-4e53-93ad-464cd810b5fe None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:38:51.494641 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad328f01-c527-4e53-93ad-464cd810b5fe None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:38:51.500352 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930c2c65-16ae-4fa6-8b72-09ea7a661345 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9c31d26f19d46f09e2f2e5e660234f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f242c4eeaa04ed19dcdc8ba95b86cfb', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:38:51.500982 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930c2c65-16ae-4fa6-8b72-09ea7a661345 service nova] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:38:51.501257 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930c2c65-16ae-4fa6-8b72-09ea7a661345 service nova] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:38:51.501523 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930c2c65-16ae-4fa6-8b72-09ea7a661345 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:38:51.509571 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930c2c65-16ae-4fa6-8b72-09ea7a661345 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:38:51.511126 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930c2c65-16ae-4fa6-8b72-09ea7a661345 service nova] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:38:51.520397 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 524/1048] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Oct 1 20:38:51 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 20:38:53.125681 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c1dd8-f93e-4cfb-99fd-908ea6464277 None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:38:53.126258 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c1dd8-f93e-4cfb-99fd-908ea6464277 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:38:53.126258 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c1dd8-f93e-4cfb-99fd-908ea6464277 None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:38:53.127536 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 525/1049] 127.0.0.1 () {54 vars in 901 bytes} [Sat Oct 1 20:38:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:38:53.132341 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea273c27-1665-4f81-ad1a-34ae14f1cbfc None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:38:53.132777 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea273c27-1665-4f81-ad1a-34ae14f1cbfc None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:38:53.132917 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea273c27-1665-4f81-ad1a-34ae14f1cbfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:38:53.152231 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-ea273c27-1665-4f81-ad1a-34ae14f1cbfc None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:38:53.153813 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-ea273c27-1665-4f81-ad1a-34ae14f1cbfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:38:53.161522 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 525/1050] 127.0.0.1 () {58 vars in 998 bytes} [Sat Oct 1 20:38:53 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:38:53.319934 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0c1dd8-f93e-4cfb-99fd-908ea6464277 None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:38:53.333205 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0c1dd8-f93e-4cfb-99fd-908ea6464277 None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:38:53.338044 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4848d2-aee3-449c-a6da-8d6b03233189 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9c31d26f19d46f09e2f2e5e660234f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f242c4eeaa04ed19dcdc8ba95b86cfb', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:38:53.338621 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4848d2-aee3-449c-a6da-8d6b03233189 service nova] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:38:53.338897 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4848d2-aee3-449c-a6da-8d6b03233189 service nova] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:38:53.339165 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4848d2-aee3-449c-a6da-8d6b03233189 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:38:53.350643 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4848d2-aee3-449c-a6da-8d6b03233189 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:38:53.352218 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4848d2-aee3-449c-a6da-8d6b03233189 service nova] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:38:53.362244 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 526/1051] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Oct 1 20:38:53 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 20:38:54.963462 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b0120-6853-47a8-a703-f0904a6186e2 None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:38:54.964054 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b0120-6853-47a8-a703-f0904a6186e2 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:38:54.964054 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b0120-6853-47a8-a703-f0904a6186e2 None None] PATH_INFO: `/` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:38:54.966157 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 526/1052] 127.0.0.1 () {54 vars in 901 bytes} [Sat Oct 1 20:38:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:38:54.970829 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6145f6d-61ab-44a2-bbab-c648a5303726 None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:38:54.971239 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6145f6d-61ab-44a2-bbab-c648a5303726 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:38:54.971348 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6145f6d-61ab-44a2-bbab-c648a5303726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:38:54.991136 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-b6145f6d-61ab-44a2-bbab-c648a5303726 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:38:54.992313 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-b6145f6d-61ab-44a2-bbab-c648a5303726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:38:54.999977 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 527/1053] 127.0.0.1 () {58 vars in 998 bytes} [Sat Oct 1 20:38:54 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:38:55.164432 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196b0120-6853-47a8-a703-f0904a6186e2 None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:38:55.172194 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=67 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:38:55.181530 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196b0120-6853-47a8-a703-f0904a6186e2 None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:38:55.186933 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b44f6c-82b0-4df6-b309-53c872f1b529 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9c31d26f19d46f09e2f2e5e660234f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f242c4eeaa04ed19dcdc8ba95b86cfb', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:38:55.187532 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b44f6c-82b0-4df6-b309-53c872f1b529 service nova] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:38:55.187807 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b44f6c-82b0-4df6-b309-53c872f1b529 service nova] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:38:55.188076 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b44f6c-82b0-4df6-b309-53c872f1b529 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:38:55.196277 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b44f6c-82b0-4df6-b309-53c872f1b529 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:38:55.197905 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b44f6c-82b0-4df6-b309-53c872f1b529 service nova] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:38:55.208325 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 527/1054] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Oct 1 20:38:55 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 20:38:56.813919 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c010746-0b27-4a80-8ed7-13e2de25bb00 None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:38:56.814496 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c010746-0b27-4a80-8ed7-13e2de25bb00 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:38:56.814496 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c010746-0b27-4a80-8ed7-13e2de25bb00 None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:38:56.815853 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 528/1055] 127.0.0.1 () {54 vars in 901 bytes} [Sat Oct 1 20:38:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:38:56.821081 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6bb1ca-fc95-4e53-ae1e-7c419d12a664 None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:38:56.821539 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6bb1ca-fc95-4e53-ae1e-7c419d12a664 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:38:56.821647 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6bb1ca-fc95-4e53-ae1e-7c419d12a664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:38:56.846422 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-9f6bb1ca-fc95-4e53-ae1e-7c419d12a664 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:38:56.847911 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-9f6bb1ca-fc95-4e53-ae1e-7c419d12a664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:38:56.859056 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 528/1056] 127.0.0.1 () {58 vars in 998 bytes} [Sat Oct 1 20:38:56 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:38:57.040355 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c010746-0b27-4a80-8ed7-13e2de25bb00 None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:38:57.056050 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c010746-0b27-4a80-8ed7-13e2de25bb00 None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:38:57.062272 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b4962-2f8f-4d7b-8b5b-0f31e132e37b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9c31d26f19d46f09e2f2e5e660234f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f242c4eeaa04ed19dcdc8ba95b86cfb', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:38:57.062905 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b4962-2f8f-4d7b-8b5b-0f31e132e37b service nova] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:38:57.063192 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b4962-2f8f-4d7b-8b5b-0f31e132e37b service nova] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:38:57.063445 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b4962-2f8f-4d7b-8b5b-0f31e132e37b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:38:57.075396 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0b4962-2f8f-4d7b-8b5b-0f31e132e37b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:38:57.077204 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0b4962-2f8f-4d7b-8b5b-0f31e132e37b service nova] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:38:57.087517 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 529/1057] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Oct 1 20:38:57 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 20:38:59.468825 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5992d1-5ca8-4da0-a81a-d535a0f5671e None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:38:59.469376 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5992d1-5ca8-4da0-a81a-d535a0f5671e None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:38:59.469376 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5992d1-5ca8-4da0-a81a-d535a0f5671e None None] PATH_INFO: `/` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:38:59.470718 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 529/1058] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 1 20:38:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:38:59.475913 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257096e4-958b-4acd-bf27-ac3ab782aae1 None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:38:59.476336 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257096e4-958b-4acd-bf27-ac3ab782aae1 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:38:59.476444 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257096e4-958b-4acd-bf27-ac3ab782aae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:38:59.495474 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-257096e4-958b-4acd-bf27-ac3ab782aae1 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:38:59.497386 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-257096e4-958b-4acd-bf27-ac3ab782aae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:38:59.505001 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 530/1059] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 1 20:38:59 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:38:59.840287 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5992d1-5ca8-4da0-a81a-d535a0f5671e None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:38:59.851103 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5992d1-5ca8-4da0-a81a-d535a0f5671e None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:38:59.854527 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70051043-1d65-404a-82ee-fbe66b7f3002 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd498314742474614b90a1350359f506a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f242c4eeaa04ed19dcdc8ba95b86cfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:38:59.855220 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70051043-1d65-404a-82ee-fbe66b7f3002 service neutron] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:38:59.855721 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70051043-1d65-404a-82ee-fbe66b7f3002 service neutron] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:38:59.856071 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70051043-1d65-404a-82ee-fbe66b7f3002 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:38:59.864678 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70051043-1d65-404a-82ee-fbe66b7f3002 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:38:59.866102 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70051043-1d65-404a-82ee-fbe66b7f3002 service neutron] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:38:59.875337 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 530/1060] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Oct 1 20:38:59 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 20:39:02.436309 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e125c195-2959-4c95-bee4-04c4ea6aa86d None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:39:02.436909 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e125c195-2959-4c95-bee4-04c4ea6aa86d None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:39:02.436909 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e125c195-2959-4c95-bee4-04c4ea6aa86d None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:39:02.438172 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 531/1061] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 1 20:39:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 01 20:39:02.443365 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a232676-5c1b-48bd-9980-4a3a4a758e88 None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:39:02.443896 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a232676-5c1b-48bd-9980-4a3a4a758e88 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:39:02.443896 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a232676-5c1b-48bd-9980-4a3a4a758e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:39:02.463143 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-2a232676-5c1b-48bd-9980-4a3a4a758e88 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:39:02.464313 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-2a232676-5c1b-48bd-9980-4a3a4a758e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:39:02.471847 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 531/1062] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 1 20:39:02 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:39:02.816847 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e125c195-2959-4c95-bee4-04c4ea6aa86d None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:39:02.828315 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e125c195-2959-4c95-bee4-04c4ea6aa86d None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:39:02.831835 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5ce6b4-9f30-448d-be79-4ca22f31d5f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd498314742474614b90a1350359f506a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f242c4eeaa04ed19dcdc8ba95b86cfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:39:02.832423 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ce6b4-9f30-448d-be79-4ca22f31d5f9 service neutron] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:39:02.832725 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ce6b4-9f30-448d-be79-4ca22f31d5f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:39:02.832998 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ce6b4-9f30-448d-be79-4ca22f31d5f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:39:02.842418 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5ce6b4-9f30-448d-be79-4ca22f31d5f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:39:02.843834 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5ce6b4-9f30-448d-be79-4ca22f31d5f9 service neutron] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:39:02.853025 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 532/1063] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Oct 1 20:39:02 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 20:39:05.653685 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc6e14-99e3-4a0a-96d5-a48971428d7e None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:39:05.654257 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc6e14-99e3-4a0a-96d5-a48971428d7e None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:39:05.654257 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc6e14-99e3-4a0a-96d5-a48971428d7e None None] PATH_INFO: `/` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:39:05.655557 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 532/1064] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 1 20:39:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:39:05.661044 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f50bf4-b766-4bf4-8612-b6020d6804c7 None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:39:05.661498 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f50bf4-b766-4bf4-8612-b6020d6804c7 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:39:05.661596 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f50bf4-b766-4bf4-8612-b6020d6804c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:39:05.681166 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-54f50bf4-b766-4bf4-8612-b6020d6804c7 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:39:05.682385 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-54f50bf4-b766-4bf4-8612-b6020d6804c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:39:05.691203 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 533/1065] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 1 20:39:05 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:39:06.039455 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecc6e14-99e3-4a0a-96d5-a48971428d7e None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:39:06.050182 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecc6e14-99e3-4a0a-96d5-a48971428d7e None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:39:06.053642 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8ac8d6-3ecc-46d9-ad4a-1a769cec5c6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd498314742474614b90a1350359f506a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f242c4eeaa04ed19dcdc8ba95b86cfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:39:06.054229 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ac8d6-3ecc-46d9-ad4a-1a769cec5c6f service neutron] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:39:06.054504 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ac8d6-3ecc-46d9-ad4a-1a769cec5c6f service neutron] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:39:06.054774 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ac8d6-3ecc-46d9-ad4a-1a769cec5c6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:39:06.064542 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8ac8d6-3ecc-46d9-ad4a-1a769cec5c6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:39:06.065970 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8ac8d6-3ecc-46d9-ad4a-1a769cec5c6f service neutron] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:39:06.075811 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 533/1066] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Oct 1 20:39:06 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 20:39:08.622247 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f1f40f-d1d0-4847-ba1a-c4a3e2d75a00 None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:39:08.622819 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f1f40f-d1d0-4847-ba1a-c4a3e2d75a00 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:39:08.622819 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f1f40f-d1d0-4847-ba1a-c4a3e2d75a00 None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:39:08.624148 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 534/1067] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 1 20:39:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:39:08.629499 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b4bc14-9130-4081-be6f-cb761968b190 None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:39:08.629926 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b4bc14-9130-4081-be6f-cb761968b190 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:39:08.630081 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b4bc14-9130-4081-be6f-cb761968b190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:39:08.649632 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-c9b4bc14-9130-4081-be6f-cb761968b190 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:39:08.650820 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-c9b4bc14-9130-4081-be6f-cb761968b190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:39:08.659436 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 534/1068] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 1 20:39:08 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:39:09.002474 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f1f40f-d1d0-4847-ba1a-c4a3e2d75a00 None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:39:09.013007 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f1f40f-d1d0-4847-ba1a-c4a3e2d75a00 None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:39:09.016385 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a66ef4b-c4d6-47e6-911d-9f55b666a532 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd498314742474614b90a1350359f506a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f242c4eeaa04ed19dcdc8ba95b86cfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:39:09.016999 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a66ef4b-c4d6-47e6-911d-9f55b666a532 service neutron] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:39:09.017271 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a66ef4b-c4d6-47e6-911d-9f55b666a532 service neutron] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:39:09.017537 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a66ef4b-c4d6-47e6-911d-9f55b666a532 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:39:09.026002 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a66ef4b-c4d6-47e6-911d-9f55b666a532 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:39:09.027914 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a66ef4b-c4d6-47e6-911d-9f55b666a532 service neutron] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:39:09.037211 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 535/1069] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Oct 1 20:39:09 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 01 20:39:11.502503 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf0e80-db07-4c46-878a-800bd1906505 None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:39:11.503090 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf0e80-db07-4c46-878a-800bd1906505 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:39:11.503090 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf0e80-db07-4c46-878a-800bd1906505 None None] PATH_INFO: `/` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:39:11.504370 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 535/1070] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 1 20:39:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:39:11.509669 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c1cba-e5ef-44ef-beb3-f4f3a87de4ec None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:39:11.510083 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c1cba-e5ef-44ef-beb3-f4f3a87de4ec None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:39:11.510199 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c1cba-e5ef-44ef-beb3-f4f3a87de4ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:39:11.517476 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=61 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:39:11.530503 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-278c1cba-e5ef-44ef-beb3-f4f3a87de4ec None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:39:11.531683 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-278c1cba-e5ef-44ef-beb3-f4f3a87de4ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:39:11.539219 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 536/1071] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 1 20:39:11 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:39:11.875946 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cf0e80-db07-4c46-878a-800bd1906505 None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:39:11.887082 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cf0e80-db07-4c46-878a-800bd1906505 None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:39:11.890477 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eae460-3048-49d3-8f7b-2f7bbb17a887 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd498314742474614b90a1350359f506a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f242c4eeaa04ed19dcdc8ba95b86cfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:39:11.891060 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eae460-3048-49d3-8f7b-2f7bbb17a887 service neutron] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:39:11.891332 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eae460-3048-49d3-8f7b-2f7bbb17a887 service neutron] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:39:11.891602 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eae460-3048-49d3-8f7b-2f7bbb17a887 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:39:11.900121 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eae460-3048-49d3-8f7b-2f7bbb17a887 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:39:11.901787 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eae460-3048-49d3-8f7b-2f7bbb17a887 service neutron] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:39:11.910954 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 536/1072] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Oct 1 20:39:11 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 01 20:39:14.387909 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1904d9-3f28-4440-a95e-db8ac7e5fcf4 None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:39:14.388444 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1904d9-3f28-4440-a95e-db8ac7e5fcf4 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:39:14.388444 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1904d9-3f28-4440-a95e-db8ac7e5fcf4 None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:39:14.389813 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 537/1073] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 1 20:39:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:39:14.395289 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23410b9c-ce15-4229-8d27-e838102a1d44 None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:39:14.395691 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23410b9c-ce15-4229-8d27-e838102a1d44 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:39:14.395833 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23410b9c-ce15-4229-8d27-e838102a1d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:39:14.414644 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-23410b9c-ce15-4229-8d27-e838102a1d44 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:39:14.415842 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-23410b9c-ce15-4229-8d27-e838102a1d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:39:14.423555 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 537/1074] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 1 20:39:14 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:39:14.764162 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1904d9-3f28-4440-a95e-db8ac7e5fcf4 None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:39:14.774688 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1904d9-3f28-4440-a95e-db8ac7e5fcf4 None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:39:14.779021 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a506deb-0159-4fcd-b18e-4197a3fac9b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd498314742474614b90a1350359f506a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f242c4eeaa04ed19dcdc8ba95b86cfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:39:14.779638 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a506deb-0159-4fcd-b18e-4197a3fac9b2 service neutron] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:39:14.779918 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a506deb-0159-4fcd-b18e-4197a3fac9b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:39:14.780186 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a506deb-0159-4fcd-b18e-4197a3fac9b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:39:14.788823 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a506deb-0159-4fcd-b18e-4197a3fac9b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:39:14.790255 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a506deb-0159-4fcd-b18e-4197a3fac9b2 service neutron] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:39:14.799762 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 538/1075] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Oct 1 20:39:14 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 20:39:17.250300 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977c090-ef78-45fc-837c-386e96db10af None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:39:17.250849 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977c090-ef78-45fc-837c-386e96db10af None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:39:17.250849 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977c090-ef78-45fc-837c-386e96db10af None None] PATH_INFO: `/` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:39:17.252166 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 538/1076] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 1 20:39:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:39:17.257435 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f33f829-6d46-409a-a6a4-5b880e5c6ceb None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:39:17.257883 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f33f829-6d46-409a-a6a4-5b880e5c6ceb None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:39:17.257981 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f33f829-6d46-409a-a6a4-5b880e5c6ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:39:17.277394 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-9f33f829-6d46-409a-a6a4-5b880e5c6ceb None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:39:17.278579 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-9f33f829-6d46-409a-a6a4-5b880e5c6ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:39:17.286368 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 539/1077] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 1 20:39:17 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:39:17.621418 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0977c090-ef78-45fc-837c-386e96db10af None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:39:17.631940 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0977c090-ef78-45fc-837c-386e96db10af None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:39:17.635855 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc0a6d9-99ad-4a7b-a063-5c482d7ef826 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd498314742474614b90a1350359f506a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f242c4eeaa04ed19dcdc8ba95b86cfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:39:17.636499 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc0a6d9-99ad-4a7b-a063-5c482d7ef826 service neutron] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:39:17.636807 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc0a6d9-99ad-4a7b-a063-5c482d7ef826 service neutron] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:39:17.637076 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc0a6d9-99ad-4a7b-a063-5c482d7ef826 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:39:17.645653 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc0a6d9-99ad-4a7b-a063-5c482d7ef826 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:39:17.647062 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc0a6d9-99ad-4a7b-a063-5c482d7ef826 service neutron] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:39:17.656718 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 539/1078] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Oct 1 20:39:17 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 20:39:20.140117 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2269fec2-0559-4a64-aa83-b9243137f4d3 None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:39:20.140697 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2269fec2-0559-4a64-aa83-b9243137f4d3 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:39:20.140697 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2269fec2-0559-4a64-aa83-b9243137f4d3 None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:39:20.141998 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 540/1079] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 1 20:39:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:39:20.147660 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31db6682-0c4d-400a-a93a-649b1e2457ba None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:39:20.148114 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31db6682-0c4d-400a-a93a-649b1e2457ba None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:39:20.148242 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31db6682-0c4d-400a-a93a-649b1e2457ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:39:20.169748 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-31db6682-0c4d-400a-a93a-649b1e2457ba None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:39:20.170944 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-31db6682-0c4d-400a-a93a-649b1e2457ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:39:20.178701 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 540/1080] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 1 20:39:20 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:39:20.516718 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2269fec2-0559-4a64-aa83-b9243137f4d3 None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:39:20.528053 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2269fec2-0559-4a64-aa83-b9243137f4d3 None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:39:20.531524 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2b1498-4eea-41ed-ad1a-b08af7b6e8e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd498314742474614b90a1350359f506a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f242c4eeaa04ed19dcdc8ba95b86cfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:39:20.532280 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b1498-4eea-41ed-ad1a-b08af7b6e8e9 service neutron] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:39:20.532461 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b1498-4eea-41ed-ad1a-b08af7b6e8e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:39:20.532760 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b1498-4eea-41ed-ad1a-b08af7b6e8e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:39:20.542686 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2b1498-4eea-41ed-ad1a-b08af7b6e8e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:39:20.544311 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2b1498-4eea-41ed-ad1a-b08af7b6e8e9 service neutron] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:39:20.554478 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 541/1081] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Oct 1 20:39:20 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 20:39:22.986769 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af2fe1b-1f85-4649-af17-a7cedfb657a7 None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:39:22.987381 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af2fe1b-1f85-4649-af17-a7cedfb657a7 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:39:22.987381 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af2fe1b-1f85-4649-af17-a7cedfb657a7 None None] PATH_INFO: `/` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:39:22.988666 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 541/1082] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 1 20:39:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:39:22.993767 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4516f0-0645-46a6-9047-4291d5a78cbb None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:39:22.994172 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4516f0-0645-46a6-9047-4291d5a78cbb None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:39:22.994311 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4516f0-0645-46a6-9047-4291d5a78cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:39:23.013993 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-cb4516f0-0645-46a6-9047-4291d5a78cbb None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:39:23.015188 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-cb4516f0-0645-46a6-9047-4291d5a78cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:39:23.023273 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 542/1083] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 1 20:39:22 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:39:23.357565 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af2fe1b-1f85-4649-af17-a7cedfb657a7 None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:39:23.367944 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af2fe1b-1f85-4649-af17-a7cedfb657a7 None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:39:23.371955 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d080a052-744d-46bc-80c5-4b3381ad4d3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd498314742474614b90a1350359f506a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f242c4eeaa04ed19dcdc8ba95b86cfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:39:23.372558 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080a052-744d-46bc-80c5-4b3381ad4d3d service neutron] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:39:23.372832 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080a052-744d-46bc-80c5-4b3381ad4d3d service neutron] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:39:23.373102 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080a052-744d-46bc-80c5-4b3381ad4d3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:39:23.381704 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d080a052-744d-46bc-80c5-4b3381ad4d3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:39:23.383121 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d080a052-744d-46bc-80c5-4b3381ad4d3d service neutron] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:39:23.393297 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 542/1084] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Oct 1 20:39:23 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 20:39:25.798596 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90d582c-2f0a-4ee2-8de2-3294dffeba48 None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:39:25.799172 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90d582c-2f0a-4ee2-8de2-3294dffeba48 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:39:25.799172 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90d582c-2f0a-4ee2-8de2-3294dffeba48 None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:39:25.800441 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 543/1085] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 1 20:39:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:39:25.805631 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c0cac0-11ea-4188-9869-a191e4654365 None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:39:25.806067 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c0cac0-11ea-4188-9869-a191e4654365 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:39:25.806203 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c0cac0-11ea-4188-9869-a191e4654365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:39:25.813770 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=51 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:39:25.826982 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-30c0cac0-11ea-4188-9869-a191e4654365 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:39:25.828170 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-30c0cac0-11ea-4188-9869-a191e4654365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:39:25.835782 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 543/1086] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 1 20:39:25 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:39:26.172259 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90d582c-2f0a-4ee2-8de2-3294dffeba48 None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:39:26.183492 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90d582c-2f0a-4ee2-8de2-3294dffeba48 None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:39:26.187237 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcff128a-3172-4a59-a06c-dce7ace690c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd498314742474614b90a1350359f506a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f242c4eeaa04ed19dcdc8ba95b86cfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:39:26.187817 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcff128a-3172-4a59-a06c-dce7ace690c2 service neutron] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:39:26.188087 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcff128a-3172-4a59-a06c-dce7ace690c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:39:26.188353 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcff128a-3172-4a59-a06c-dce7ace690c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:39:26.197612 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcff128a-3172-4a59-a06c-dce7ace690c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:39:26.198934 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcff128a-3172-4a59-a06c-dce7ace690c2 service neutron] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:39:26.207937 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 544/1087] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Oct 1 20:39:26 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 20:39:35.821495 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=2 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:39:36.203961 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=26 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:39:50.842301 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca9cf58-1b34-4cec-8f9a-285564af4476 None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:39:50.842896 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca9cf58-1b34-4cec-8f9a-285564af4476 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:39:50.842896 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca9cf58-1b34-4cec-8f9a-285564af4476 None None] PATH_INFO: `/` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:39:50.844189 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 544/1088] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:39:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:39:50.850174 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc1c73c-c521-43bf-8559-18839c9f8c37 None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:39:50.850889 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc1c73c-c521-43bf-8559-18839c9f8c37 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:39:50.851073 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc1c73c-c521-43bf-8559-18839c9f8c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:39:50.876169 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-ebc1c73c-c521-43bf-8559-18839c9f8c37 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:39:50.877870 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-ebc1c73c-c521-43bf-8559-18839c9f8c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:39:50.889418 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 545/1089] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:39:50 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:39:51.244353 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd36f47-c3c8-4a2b-8aad-fd1a641e3a8b None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:39:51.244730 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd36f47-c3c8-4a2b-8aad-fd1a641e3a8b None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:39:51.245081 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd36f47-c3c8-4a2b-8aad-fd1a641e3a8b None None] PATH_INFO: `/` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:39:51.246634 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 545/1090] 10.222.0.23 () {54 vars in 962 bytes} [Sat Oct 1 20:39:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:39:51.252952 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801dee5e-1929-42a2-8b44-67e98cc201f3 None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:39:51.253353 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801dee5e-1929-42a2-8b44-67e98cc201f3 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:39:51.253716 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801dee5e-1929-42a2-8b44-67e98cc201f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:39:51.279798 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-801dee5e-1929-42a2-8b44-67e98cc201f3 None None] MFA Rules not processed for user `4029dd2379eb4f5aab7c129a94d29b0c`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:39:51.281452 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-801dee5e-1929-42a2-8b44-67e98cc201f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:39:51.290677 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 546/1091] 10.222.0.23 () {58 vars in 1059 bytes} [Sat Oct 1 20:39:51 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:39:51.298341 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd36f47-c3c8-4a2b-8aad-fd1a641e3a8b None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:39:51.308798 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd36f47-c3c8-4a2b-8aad-fd1a641e3a8b None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:39:51.312449 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06455557-ffd2-44a7-9c76-c8ec2cffdbd0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4029dd2379eb4f5aab7c129a94d29b0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f242c4eeaa04ed19dcdc8ba95b86cfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:39:51.313056 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06455557-ffd2-44a7-9c76-c8ec2cffdbd0 service glance] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:39:51.313349 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06455557-ffd2-44a7-9c76-c8ec2cffdbd0 service glance] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:39:51.313612 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06455557-ffd2-44a7-9c76-c8ec2cffdbd0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:39:51.322762 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06455557-ffd2-44a7-9c76-c8ec2cffdbd0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:39:51.324165 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06455557-ffd2-44a7-9c76-c8ec2cffdbd0 service glance] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:39:51.333639 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 546/1092] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Oct 1 20:39:51 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 20:39:54.293798 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df7e0f1-5698-498f-ac79-94695ed5b10c None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:39:54.294369 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df7e0f1-5698-498f-ac79-94695ed5b10c None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:39:54.294472 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df7e0f1-5698-498f-ac79-94695ed5b10c None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:39:54.296347 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 547/1093] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:39:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:39:54.302008 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a47c9c9-87ed-44f1-ab68-e6148574279f None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:39:54.302464 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a47c9c9-87ed-44f1-ab68-e6148574279f None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:39:54.302593 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a47c9c9-87ed-44f1-ab68-e6148574279f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:39:54.323637 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-2a47c9c9-87ed-44f1-ab68-e6148574279f None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:39:54.324929 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-2a47c9c9-87ed-44f1-ab68-e6148574279f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:39:54.333616 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 547/1094] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:39:54 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:39:54.688266 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df7e0f1-5698-498f-ac79-94695ed5b10c None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:39:54.705749 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df7e0f1-5698-498f-ac79-94695ed5b10c None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:39:54.712424 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ea8995-86a4-4d2c-848a-02b21652119a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f2619d8f534f3eace3cce529462560', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:39:54.713299 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ea8995-86a4-4d2c-848a-02b21652119a admin admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:39:54.713707 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ea8995-86a4-4d2c-848a-02b21652119a admin admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:39:54.714069 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ea8995-86a4-4d2c-848a-02b21652119a admin admin] PATH_INFO: `/v3/projects` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:39:54.714946 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ea8995-86a4-4d2c-848a-02b21652119a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:39:54.717465 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: WARNING py.warnings [None req-17ea8995-86a4-4d2c-848a-02b21652119a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 01 20:39:54.717465 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: warnings.warn(msg) Oct 01 20:39:54.717465 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: Oct 01 20:39:54.719162 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ea8995-86a4-4d2c-848a-02b21652119a admin admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:39:54.741402 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 548/1095] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Oct 1 20:39:54 2022] GET /identity/v3/projects => generated 1606 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 20:39:57.186677 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604d4c09-c1d6-4bfe-9989-393c5fa5be1d None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:39:57.187121 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604d4c09-c1d6-4bfe-9989-393c5fa5be1d None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:39:57.187230 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604d4c09-c1d6-4bfe-9989-393c5fa5be1d None None] PATH_INFO: `/` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:39:57.188545 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 548/1096] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:39:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:39:57.193676 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f61039-8970-48b8-a8aa-ed073c2b76e2 None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:39:57.194118 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f61039-8970-48b8-a8aa-ed073c2b76e2 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:39:57.194216 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f61039-8970-48b8-a8aa-ed073c2b76e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:39:57.215270 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-a0f61039-8970-48b8-a8aa-ed073c2b76e2 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:39:57.216461 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-a0f61039-8970-48b8-a8aa-ed073c2b76e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:39:57.224076 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 549/1097] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:39:57 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:39:57.570301 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604d4c09-c1d6-4bfe-9989-393c5fa5be1d None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:39:57.583652 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604d4c09-c1d6-4bfe-9989-393c5fa5be1d None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:39:57.588637 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611bc844-ba4b-4b95-8bdb-8f8995d6f07f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9c31d26f19d46f09e2f2e5e660234f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f242c4eeaa04ed19dcdc8ba95b86cfb', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:39:57.589218 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611bc844-ba4b-4b95-8bdb-8f8995d6f07f service nova] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:39:57.589489 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611bc844-ba4b-4b95-8bdb-8f8995d6f07f service nova] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:39:57.589769 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611bc844-ba4b-4b95-8bdb-8f8995d6f07f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:39:57.597785 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611bc844-ba4b-4b95-8bdb-8f8995d6f07f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:39:57.599375 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611bc844-ba4b-4b95-8bdb-8f8995d6f07f service nova] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:39:57.609296 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 549/1098] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Oct 1 20:39:57 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 20:40:00.349848 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1adcb4-ce41-44a2-92a1-c13cd1a7d78d None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:40:00.350381 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1adcb4-ce41-44a2-92a1-c13cd1a7d78d None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:40:00.350381 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1adcb4-ce41-44a2-92a1-c13cd1a7d78d None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:40:00.351653 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 550/1099] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:40:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:40:00.357591 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ebbd5b-7f64-48d7-92f1-1552584d0ba6 None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:40:00.358019 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ebbd5b-7f64-48d7-92f1-1552584d0ba6 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:40:00.358166 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ebbd5b-7f64-48d7-92f1-1552584d0ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:40:00.377804 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-a6ebbd5b-7f64-48d7-92f1-1552584d0ba6 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:40:00.379013 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-a6ebbd5b-7f64-48d7-92f1-1552584d0ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:40:00.386955 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 550/1100] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:40:00 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:40:00.745856 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1adcb4-ce41-44a2-92a1-c13cd1a7d78d None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:40:00.756472 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1adcb4-ce41-44a2-92a1-c13cd1a7d78d None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:40:00.760021 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3539dcdc-253d-4e45-8536-25d3cb72ed85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd498314742474614b90a1350359f506a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f242c4eeaa04ed19dcdc8ba95b86cfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:40:00.760641 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3539dcdc-253d-4e45-8536-25d3cb72ed85 service neutron] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:40:00.760915 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3539dcdc-253d-4e45-8536-25d3cb72ed85 service neutron] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:40:00.761177 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3539dcdc-253d-4e45-8536-25d3cb72ed85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:40:00.769852 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3539dcdc-253d-4e45-8536-25d3cb72ed85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:40:00.771278 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3539dcdc-253d-4e45-8536-25d3cb72ed85 service neutron] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:40:00.781388 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 551/1101] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Oct 1 20:40:00 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 20:40:03.266206 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a31a4-d0ac-48bb-be2f-a66b3d0472c0 None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:40:03.266778 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a31a4-d0ac-48bb-be2f-a66b3d0472c0 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:40:03.266778 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a31a4-d0ac-48bb-be2f-a66b3d0472c0 None None] PATH_INFO: `/` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:40:03.268085 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 551/1102] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:40:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:40:03.273534 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f5fe7-3179-4f6c-8b04-7710bdf94dd7 None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:40:03.274735 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f5fe7-3179-4f6c-8b04-7710bdf94dd7 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:40:03.274897 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f5fe7-3179-4f6c-8b04-7710bdf94dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:40:03.294067 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-be1f5fe7-3179-4f6c-8b04-7710bdf94dd7 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:40:03.295235 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-be1f5fe7-3179-4f6c-8b04-7710bdf94dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:40:03.302834 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 552/1103] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:40:03 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:40:03.649660 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2a31a4-d0ac-48bb-be2f-a66b3d0472c0 None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:40:03.660169 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2a31a4-d0ac-48bb-be2f-a66b3d0472c0 None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:40:03.663634 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54592919-12fb-4d5b-898f-e92560e35f39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd498314742474614b90a1350359f506a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f242c4eeaa04ed19dcdc8ba95b86cfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:40:03.664331 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54592919-12fb-4d5b-898f-e92560e35f39 service neutron] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:40:03.664737 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54592919-12fb-4d5b-898f-e92560e35f39 service neutron] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:40:03.664979 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54592919-12fb-4d5b-898f-e92560e35f39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:40:03.673639 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54592919-12fb-4d5b-898f-e92560e35f39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:40:03.675057 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54592919-12fb-4d5b-898f-e92560e35f39 service neutron] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:40:03.684229 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 552/1104] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Oct 1 20:40:03 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 20:40:06.236370 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b8bdb-0fd8-4e00-8f58-ebd15c4d213b None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:40:06.236929 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b8bdb-0fd8-4e00-8f58-ebd15c4d213b None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:40:06.236929 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b8bdb-0fd8-4e00-8f58-ebd15c4d213b None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:40:06.238286 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 553/1105] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:40:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:40:06.244066 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e592d0eb-d217-4bb7-8f74-432b70289ad4 None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:40:06.244458 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e592d0eb-d217-4bb7-8f74-432b70289ad4 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:40:06.244644 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e592d0eb-d217-4bb7-8f74-432b70289ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:40:06.264205 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-e592d0eb-d217-4bb7-8f74-432b70289ad4 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:40:06.265412 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-e592d0eb-d217-4bb7-8f74-432b70289ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:40:06.273037 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 553/1106] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:40:06 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:40:06.629298 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79b8bdb-0fd8-4e00-8f58-ebd15c4d213b None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:40:06.640217 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79b8bdb-0fd8-4e00-8f58-ebd15c4d213b None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:40:06.643588 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77996d54-b37b-49b6-bd2a-c16c63c784d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd498314742474614b90a1350359f506a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f242c4eeaa04ed19dcdc8ba95b86cfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:40:06.644162 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77996d54-b37b-49b6-bd2a-c16c63c784d8 service neutron] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:40:06.644431 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77996d54-b37b-49b6-bd2a-c16c63c784d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:40:06.644727 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77996d54-b37b-49b6-bd2a-c16c63c784d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:40:06.654190 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77996d54-b37b-49b6-bd2a-c16c63c784d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:40:06.655607 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77996d54-b37b-49b6-bd2a-c16c63c784d8 service neutron] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:40:06.664680 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 554/1107] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Oct 1 20:40:06 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 20:40:09.270825 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312f69d4-e63b-40db-a5d5-1049a27faa42 None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:40:09.271377 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312f69d4-e63b-40db-a5d5-1049a27faa42 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:40:09.271377 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312f69d4-e63b-40db-a5d5-1049a27faa42 None None] PATH_INFO: `/` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:40:09.272733 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 554/1108] 10.222.0.23 () {54 vars in 927 bytes} [Sat Oct 1 20:40:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:40:09.278062 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac31094c-22e9-46e4-8d02-fa996e0751e8 None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:40:09.278492 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac31094c-22e9-46e4-8d02-fa996e0751e8 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:40:09.278691 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac31094c-22e9-46e4-8d02-fa996e0751e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:40:09.297387 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-ac31094c-22e9-46e4-8d02-fa996e0751e8 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:40:09.298564 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-ac31094c-22e9-46e4-8d02-fa996e0751e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:40:09.306650 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 555/1109] 10.222.0.23 () {58 vars in 1024 bytes} [Sat Oct 1 20:40:09 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 01 20:40:09.646813 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312f69d4-e63b-40db-a5d5-1049a27faa42 None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:40:09.657958 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312f69d4-e63b-40db-a5d5-1049a27faa42 None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:40:09.661352 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d393c5-204c-4c01-bc4f-f72edb456ff4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd498314742474614b90a1350359f506a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f242c4eeaa04ed19dcdc8ba95b86cfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:40:09.661935 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d393c5-204c-4c01-bc4f-f72edb456ff4 service neutron] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:40:09.662205 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d393c5-204c-4c01-bc4f-f72edb456ff4 service neutron] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:40:09.662471 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d393c5-204c-4c01-bc4f-f72edb456ff4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:40:09.671294 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d393c5-204c-4c01-bc4f-f72edb456ff4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:40:09.672744 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d393c5-204c-4c01-bc4f-f72edb456ff4 service neutron] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:40:09.681767 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 555/1110] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Oct 1 20:40:09 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 20:40:19.292759 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=33 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:40:19.677800 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=33 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:41:31.327741 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66139f7f-a2ba-4391-b49f-90c0d61ae066 None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:41:31.328356 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66139f7f-a2ba-4391-b49f-90c0d61ae066 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:41:31.328356 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66139f7f-a2ba-4391-b49f-90c0d61ae066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:41:31.348176 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-66139f7f-a2ba-4391-b49f-90c0d61ae066 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:41:31.349439 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-66139f7f-a2ba-4391-b49f-90c0d61ae066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:41:31.357217 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 556/1111] 10.222.0.23 () {58 vars in 958 bytes} [Sat Oct 1 20:41:31 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:41:31.365046 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf8b22c-21d2-46eb-8f7a-6243879d04de None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:41:31.365579 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf8b22c-21d2-46eb-8f7a-6243879d04de None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:41:31.365579 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf8b22c-21d2-46eb-8f7a-6243879d04de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:41:31.384991 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-2bf8b22c-21d2-46eb-8f7a-6243879d04de None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:41:31.386174 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-2bf8b22c-21d2-46eb-8f7a-6243879d04de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:41:31.393845 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 556/1112] 10.222.0.23 () {58 vars in 958 bytes} [Sat Oct 1 20:41:31 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:41:31.398914 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66139f7f-a2ba-4391-b49f-90c0d61ae066 None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:41:31.408342 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66139f7f-a2ba-4391-b49f-90c0d61ae066 None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:41:31.412949 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065168c2-716f-4a33-a28d-a8a4c2c4b5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f2619d8f534f3eace3cce529462560', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:41:31.413528 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065168c2-716f-4a33-a28d-a8a4c2c4b5e3 admin admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:41:31.413799 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065168c2-716f-4a33-a28d-a8a4c2c4b5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:41:31.414063 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065168c2-716f-4a33-a28d-a8a4c2c4b5e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:41:31.414690 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065168c2-716f-4a33-a28d-a8a4c2c4b5e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:41:31.414989 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065168c2-716f-4a33-a28d-a8a4c2c4b5e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:41:31.415990 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: WARNING py.warnings [None req-065168c2-716f-4a33-a28d-a8a4c2c4b5e3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 01 20:41:31.415990 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: warnings.warn(msg) Oct 01 20:41:31.415990 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: Oct 01 20:41:31.416897 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065168c2-716f-4a33-a28d-a8a4c2c4b5e3 admin admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:41:31.427895 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 557/1113] 10.222.0.23 () {58 vars in 1153 bytes} [Sat Oct 1 20:41:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:41:31.436261 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf8b22c-21d2-46eb-8f7a-6243879d04de None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:41:31.445758 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf8b22c-21d2-46eb-8f7a-6243879d04de None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:41:31.450242 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7276ffe8-8460-4811-8d0b-930a8596d0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f2619d8f534f3eace3cce529462560', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:41:31.450825 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7276ffe8-8460-4811-8d0b-930a8596d0f0 admin admin] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:41:31.451096 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7276ffe8-8460-4811-8d0b-930a8596d0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:41:31.451360 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7276ffe8-8460-4811-8d0b-930a8596d0f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:41:31.451980 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7276ffe8-8460-4811-8d0b-930a8596d0f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:41:31.453795 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: WARNING py.warnings [None req-7276ffe8-8460-4811-8d0b-930a8596d0f0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 01 20:41:31.453795 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: warnings.warn(msg) Oct 01 20:41:31.453795 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: Oct 01 20:41:31.454965 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7276ffe8-8460-4811-8d0b-930a8596d0f0 admin admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:41:31.481436 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 557/1114] 10.222.0.23 () {60 vars in 1153 bytes} [Sat Oct 1 20:41:31 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 20:41:31.485585 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065168c2-716f-4a33-a28d-a8a4c2c4b5e3 admin admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:41:31.496107 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065168c2-716f-4a33-a28d-a8a4c2c4b5e3 admin admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:41:31.551342 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be461942-7f9a-48d0-9a7b-5ab471825f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f2619d8f534f3eace3cce529462560', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:41:31.551935 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be461942-7f9a-48d0-9a7b-5ab471825f0b admin admin] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:41:31.552212 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be461942-7f9a-48d0-9a7b-5ab471825f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:41:31.552481 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be461942-7f9a-48d0-9a7b-5ab471825f0b admin admin] PATH_INFO: `/v3/users` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:41:31.553136 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be461942-7f9a-48d0-9a7b-5ab471825f0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:41:31.554141 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: WARNING py.warnings [None req-be461942-7f9a-48d0-9a7b-5ab471825f0b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 01 20:41:31.554141 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: warnings.warn(msg) Oct 01 20:41:31.554141 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: Oct 01 20:41:31.555352 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be461942-7f9a-48d0-9a7b-5ab471825f0b admin admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:41:31.577737 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 558/1115] 10.222.0.23 () {60 vars in 1144 bytes} [Sat Oct 1 20:41:31 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 20:41:31.582334 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7276ffe8-8460-4811-8d0b-930a8596d0f0 admin admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:41:31.592416 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7276ffe8-8460-4811-8d0b-930a8596d0f0 admin admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:41:31.597523 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0099fb66-6dda-4ec7-bef6-b3aa58a3c04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f2619d8f534f3eace3cce529462560', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:41:31.598313 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0099fb66-6dda-4ec7-bef6-b3aa58a3c04c admin admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:41:31.598622 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0099fb66-6dda-4ec7-bef6-b3aa58a3c04c admin admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:41:31.598897 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0099fb66-6dda-4ec7-bef6-b3aa58a3c04c admin admin] PATH_INFO: `/v3/roles` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:41:31.599529 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0099fb66-6dda-4ec7-bef6-b3aa58a3c04c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:41:31.600671 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: WARNING py.warnings [None req-0099fb66-6dda-4ec7-bef6-b3aa58a3c04c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 01 20:41:31.600671 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: warnings.warn(msg) Oct 01 20:41:31.600671 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: Oct 01 20:41:31.601574 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0099fb66-6dda-4ec7-bef6-b3aa58a3c04c admin admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:41:31.614915 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 558/1116] 10.222.0.23 () {58 vars in 1122 bytes} [Sat Oct 1 20:41:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 20:41:31.618814 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be461942-7f9a-48d0-9a7b-5ab471825f0b admin admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:41:31.629077 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be461942-7f9a-48d0-9a7b-5ab471825f0b admin admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:41:31.633657 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6384becd-aa38-4ab2-8a9d-a4613b50b63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f2619d8f534f3eace3cce529462560', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:41:31.634241 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384becd-aa38-4ab2-8a9d-a4613b50b63d admin admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:41:31.634519 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384becd-aa38-4ab2-8a9d-a4613b50b63d admin admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:41:31.634792 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384becd-aa38-4ab2-8a9d-a4613b50b63d admin admin] PATH_INFO: `/v3/roles` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:41:31.635423 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6384becd-aa38-4ab2-8a9d-a4613b50b63d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:41:31.636422 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: WARNING py.warnings [None req-6384becd-aa38-4ab2-8a9d-a4613b50b63d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 01 20:41:31.636422 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: warnings.warn(msg) Oct 01 20:41:31.636422 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: Oct 01 20:41:31.637371 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6384becd-aa38-4ab2-8a9d-a4613b50b63d admin admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:41:31.650285 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 559/1117] 10.222.0.23 () {58 vars in 1122 bytes} [Sat Oct 1 20:41:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 20:41:31.654269 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0099fb66-6dda-4ec7-bef6-b3aa58a3c04c admin admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:41:31.664068 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0099fb66-6dda-4ec7-bef6-b3aa58a3c04c admin admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:41:31.668648 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c74c6a-73db-43cd-9788-abb9d1ed9a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f2619d8f534f3eace3cce529462560', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:41:31.669304 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c74c6a-73db-43cd-9788-abb9d1ed9a7a admin admin] REQUEST_METHOD: `PUT` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:41:31.669567 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c74c6a-73db-43cd-9788-abb9d1ed9a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:41:31.669844 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c74c6a-73db-43cd-9788-abb9d1ed9a7a admin admin] PATH_INFO: `/v3/projects/9b4ffe15dcdd45d9af3509a544daa674/users/d419a249f6844a999ff476a7c7e91556/roles/82138515a02147ccb30f8d56863aab87` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:41:31.685079 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c74c6a-73db-43cd-9788-abb9d1ed9a7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b4ffe15dcdd45d9af3509a544daa674, user_id=d419a249f6844a999ff476a7c7e91556, role_id=82138515a02147ccb30f8d56863aab87)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:41:31.686135 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: WARNING py.warnings [None req-d2c74c6a-73db-43cd-9788-abb9d1ed9a7a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 01 20:41:31.686135 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: warnings.warn(msg) Oct 01 20:41:31.686135 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: Oct 01 20:41:31.688059 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c74c6a-73db-43cd-9788-abb9d1ed9a7a admin admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:41:31.701587 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 559/1118] 10.222.0.23 () {60 vars in 1483 bytes} [Sat Oct 1 20:41:31 2022] PUT /identity/v3/projects/9b4ffe15dcdd45d9af3509a544daa674/users/d419a249f6844a999ff476a7c7e91556/roles/82138515a02147ccb30f8d56863aab87 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 01 20:41:31.713833 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc7a9ae-d98c-487c-b890-b9dfbe61ab90 None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:41:31.714113 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc7a9ae-d98c-487c-b890-b9dfbe61ab90 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:41:31.714401 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc7a9ae-d98c-487c-b890-b9dfbe61ab90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:41:31.741912 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-6fc7a9ae-d98c-487c-b890-b9dfbe61ab90 None None] MFA Rules not processed for user `d419a249f6844a999ff476a7c7e91556`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:41:31.743133 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-6fc7a9ae-d98c-487c-b890-b9dfbe61ab90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:41:31.806778 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 560/1119] 10.222.0.23 () {58 vars in 958 bytes} [Sat Oct 1 20:41:31 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:41:31.820694 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b2a35-22d4-4cd7-adae-7052de0b2676 None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:41:31.820983 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b2a35-22d4-4cd7-adae-7052de0b2676 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:41:31.821285 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b2a35-22d4-4cd7-adae-7052de0b2676 None None] PATH_INFO: `/` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:41:31.822621 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 560/1120] 10.222.0.23 () {54 vars in 963 bytes} [Sat Oct 1 20:41:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:41:31.827640 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b6df04-744a-4245-b674-d5687ff8f13a None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:41:31.827925 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b6df04-744a-4245-b674-d5687ff8f13a None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:41:31.828204 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b6df04-744a-4245-b674-d5687ff8f13a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:41:31.848088 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-31b6df04-744a-4245-b674-d5687ff8f13a None None] MFA Rules not processed for user `1b737fe6e9f34adf8eef1851a4a89ca6`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:41:31.849217 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-31b6df04-744a-4245-b674-d5687ff8f13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:41:31.891420 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:41:31.899467 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 561/1121] 10.222.0.23 () {58 vars in 1060 bytes} [Sat Oct 1 20:41:31 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:41:31.907037 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681b2a35-22d4-4cd7-adae-7052de0b2676 None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:41:31.917963 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681b2a35-22d4-4cd7-adae-7052de0b2676 None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:41:31.921321 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b2906d-b257-41cd-b349-ec06ae5400b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b737fe6e9f34adf8eef1851a4a89ca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f242c4eeaa04ed19dcdc8ba95b86cfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:41:31.921896 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b2906d-b257-41cd-b349-ec06ae5400b4 service cinder] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:41:31.922168 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b2906d-b257-41cd-b349-ec06ae5400b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:41:31.922435 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b2906d-b257-41cd-b349-ec06ae5400b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:41:31.930846 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b2906d-b257-41cd-b349-ec06ae5400b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:41:31.932249 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b2906d-b257-41cd-b349-ec06ae5400b4 service cinder] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:41:31.940949 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 561/1122] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Oct 1 20:41:31 2022] GET /identity/v3/auth/tokens => generated 2814 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 20:41:31.978702 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b1b135-83ed-4ab6-b1d0-fa8a337a3250 None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:41:31.978987 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b1b135-83ed-4ab6-b1d0-fa8a337a3250 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:41:31.979265 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b1b135-83ed-4ab6-b1d0-fa8a337a3250 None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:41:31.980505 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 562/1123] 10.222.0.23 () {52 vars in 830 bytes} [Sat Oct 1 20:41:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:41:31.983973 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b2906d-b257-41cd-b349-ec06ae5400b4 service cinder] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:41:32.043371 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b2906d-b257-41cd-b349-ec06ae5400b4 service cinder] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:41:32.047860 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fd241b-83f4-4cb3-852c-84eb3f1ff8d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f2619d8f534f3eace3cce529462560', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:41:32.048464 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd241b-83f4-4cb3-852c-84eb3f1ff8d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:41:32.048767 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd241b-83f4-4cb3-852c-84eb3f1ff8d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:41:32.049036 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd241b-83f4-4cb3-852c-84eb3f1ff8d8 admin admin] PATH_INFO: `/v3/users/d419a249f6844a999ff476a7c7e91556` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:41:32.050136 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fd241b-83f4-4cb3-852c-84eb3f1ff8d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d419a249f6844a999ff476a7c7e91556)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:41:32.051716 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: WARNING py.warnings [None req-61fd241b-83f4-4cb3-852c-84eb3f1ff8d8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 01 20:41:32.051716 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: warnings.warn(msg) Oct 01 20:41:32.051716 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: Oct 01 20:41:32.052942 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fd241b-83f4-4cb3-852c-84eb3f1ff8d8 admin admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:41:32.119555 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.notifications [None req-61fd241b-83f4-4cb3-852c-84eb3f1ff8d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd419a249f6844a999ff476a7c7e91556'} {{(pid=94756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 20:41:32.120125 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.notifications [None req-61fd241b-83f4-4cb3-852c-84eb3f1ff8d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd419a249f6844a999ff476a7c7e91556'} {{(pid=94756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 20:41:32.130315 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.notifications [None req-61fd241b-83f4-4cb3-852c-84eb3f1ff8d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd419a249f6844a999ff476a7c7e91556'} {{(pid=94756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 20:41:32.143888 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.notifications [None req-61fd241b-83f4-4cb3-852c-84eb3f1ff8d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd419a249f6844a999ff476a7c7e91556'} {{(pid=94756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 20:41:32.145185 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.notifications [None req-61fd241b-83f4-4cb3-852c-84eb3f1ff8d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd419a249f6844a999ff476a7c7e91556'} {{(pid=94756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 20:41:32.177256 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 562/1124] 10.222.0.23 () {58 vars in 1224 bytes} [Sat Oct 1 20:41:31 2022] DELETE /identity/v3/users/d419a249f6844a999ff476a7c7e91556 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 20:41:32.181574 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f306e90-9953-4bb3-8041-58f1d4b08792 None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:41:32.181857 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f306e90-9953-4bb3-8041-58f1d4b08792 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:41:32.182152 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f306e90-9953-4bb3-8041-58f1d4b08792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:41:32.201097 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-0f306e90-9953-4bb3-8041-58f1d4b08792 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:41:32.202323 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-0f306e90-9953-4bb3-8041-58f1d4b08792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:41:32.264449 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 563/1125] 10.222.0.23 () {58 vars in 958 bytes} [Sat Oct 1 20:41:32 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:41:32.274739 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fd241b-83f4-4cb3-852c-84eb3f1ff8d8 admin admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:41:32.276128 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-61fd241b-83f4-4cb3-852c-84eb3f1ff8d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:41:32.281434 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:41:32.335451 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fd241b-83f4-4cb3-852c-84eb3f1ff8d8 admin admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:41:32.339034 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213dcbd8-6a9a-43b8-bff9-059e01065a66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd498314742474614b90a1350359f506a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f242c4eeaa04ed19dcdc8ba95b86cfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:41:32.339632 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213dcbd8-6a9a-43b8-bff9-059e01065a66 service neutron] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:41:32.339908 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213dcbd8-6a9a-43b8-bff9-059e01065a66 service neutron] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:41:32.340177 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213dcbd8-6a9a-43b8-bff9-059e01065a66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:41:32.349874 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213dcbd8-6a9a-43b8-bff9-059e01065a66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:41:32.351297 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213dcbd8-6a9a-43b8-bff9-059e01065a66 service neutron] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:41:32.360355 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 563/1126] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Oct 1 20:41:32 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 20:41:32.751996 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f306e90-9953-4bb3-8041-58f1d4b08792 None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:41:32.754096 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-0f306e90-9953-4bb3-8041-58f1d4b08792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:41:32.765859 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f306e90-9953-4bb3-8041-58f1d4b08792 None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:41:32.771496 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634b8e76-196f-4d4f-b1ad-c42971247484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f2619d8f534f3eace3cce529462560', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:41:32.772121 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634b8e76-196f-4d4f-b1ad-c42971247484 admin admin] REQUEST_METHOD: `DELETE` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:41:32.772459 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634b8e76-196f-4d4f-b1ad-c42971247484 admin admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:41:32.772763 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634b8e76-196f-4d4f-b1ad-c42971247484 admin admin] PATH_INFO: `/v3/projects/9b4ffe15dcdd45d9af3509a544daa674` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:41:32.773925 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634b8e76-196f-4d4f-b1ad-c42971247484 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b4ffe15dcdd45d9af3509a544daa674)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:41:32.774981 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: WARNING py.warnings [None req-634b8e76-196f-4d4f-b1ad-c42971247484 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 01 20:41:32.774981 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: warnings.warn(msg) Oct 01 20:41:32.774981 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: Oct 01 20:41:32.776100 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634b8e76-196f-4d4f-b1ad-c42971247484 admin admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:41:32.838266 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.notifications [None req-634b8e76-196f-4d4f-b1ad-c42971247484 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b4ffe15dcdd45d9af3509a544daa674', 'request_id': 'req-634b8e76-196f-4d4f-b1ad-c42971247484'} {{(pid=94755) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 20:41:32.846722 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.notifications [None req-634b8e76-196f-4d4f-b1ad-c42971247484 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b4ffe15dcdd45d9af3509a544daa674', 'request_id': 'req-634b8e76-196f-4d4f-b1ad-c42971247484'} {{(pid=94755) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 20:41:32.853163 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.notifications [None req-634b8e76-196f-4d4f-b1ad-c42971247484 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b4ffe15dcdd45d9af3509a544daa674', 'request_id': 'req-634b8e76-196f-4d4f-b1ad-c42971247484'} {{(pid=94755) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 20:41:32.871158 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.notifications [None req-634b8e76-196f-4d4f-b1ad-c42971247484 admin admin] The token cache is being invalidate because project 9b4ffe15dcdd45d9af3509a544daa674 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=94755) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 20:41:32.871445 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.notifications [None req-634b8e76-196f-4d4f-b1ad-c42971247484 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=94755) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 20:41:32.872162 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.notifications [None req-634b8e76-196f-4d4f-b1ad-c42971247484 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=94755) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 20:41:32.873659 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 564/1127] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Oct 1 20:41:32 2022] DELETE /identity/v3/projects/9b4ffe15dcdd45d9af3509a544daa674 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 20:41:42.356448 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=25 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:41:42.868225 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:42:54.625685 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1d0053-fd76-425c-adb5-c6effb7a86b3 None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:42:54.626289 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1d0053-fd76-425c-adb5-c6effb7a86b3 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:42:54.626289 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1d0053-fd76-425c-adb5-c6effb7a86b3 None None] PATH_INFO: `/` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:42:54.627563 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 564/1128] 127.0.0.1 () {54 vars in 901 bytes} [Sat Oct 1 20:42:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:42:54.632309 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a40770-b52a-4c30-8ce2-624d9d35ea9d None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:42:54.632817 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a40770-b52a-4c30-8ce2-624d9d35ea9d None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:42:54.632922 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a40770-b52a-4c30-8ce2-624d9d35ea9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:42:54.700443 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-22a40770-b52a-4c30-8ce2-624d9d35ea9d None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:42:54.701667 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-22a40770-b52a-4c30-8ce2-624d9d35ea9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:42:54.796149 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 565/1129] 127.0.0.1 () {58 vars in 998 bytes} [Sat Oct 1 20:42:54 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:42:54.963846 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1d0053-fd76-425c-adb5-c6effb7a86b3 None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:42:54.965590 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-1c1d0053-fd76-425c-adb5-c6effb7a86b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:42:55.053263 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1d0053-fd76-425c-adb5-c6effb7a86b3 None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:42:55.058991 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80faa0fd-dc58-4b69-a238-0197e390a803 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9c31d26f19d46f09e2f2e5e660234f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f242c4eeaa04ed19dcdc8ba95b86cfb', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:42:55.059584 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80faa0fd-dc58-4b69-a238-0197e390a803 service nova] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:42:55.059860 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80faa0fd-dc58-4b69-a238-0197e390a803 service nova] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:42:55.060126 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80faa0fd-dc58-4b69-a238-0197e390a803 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:42:55.068191 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80faa0fd-dc58-4b69-a238-0197e390a803 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:42:55.069859 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80faa0fd-dc58-4b69-a238-0197e390a803 service nova] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:42:55.079333 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 565/1130] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Oct 1 20:42:54 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 20:42:56.752215 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7000c25f-05cc-41eb-946f-5c33cb6d0ce7 None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:42:56.752851 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7000c25f-05cc-41eb-946f-5c33cb6d0ce7 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:42:56.752851 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7000c25f-05cc-41eb-946f-5c33cb6d0ce7 None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:42:56.754133 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 566/1131] 127.0.0.1 () {54 vars in 901 bytes} [Sat Oct 1 20:42:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:42:56.758933 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240be1ce-ccd0-43fc-b9d0-a980f5b4aa5e None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:42:56.759342 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240be1ce-ccd0-43fc-b9d0-a980f5b4aa5e None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:42:56.759483 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240be1ce-ccd0-43fc-b9d0-a980f5b4aa5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:42:56.778994 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-240be1ce-ccd0-43fc-b9d0-a980f5b4aa5e None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:42:56.780297 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-240be1ce-ccd0-43fc-b9d0-a980f5b4aa5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:42:56.788766 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 566/1132] 127.0.0.1 () {58 vars in 998 bytes} [Sat Oct 1 20:42:56 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:42:56.947956 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7000c25f-05cc-41eb-946f-5c33cb6d0ce7 None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:42:56.964164 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7000c25f-05cc-41eb-946f-5c33cb6d0ce7 None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:42:56.969673 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8236511b-cca9-4316-ba7a-f60d16d85e77 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9c31d26f19d46f09e2f2e5e660234f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f242c4eeaa04ed19dcdc8ba95b86cfb', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:42:56.970264 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8236511b-cca9-4316-ba7a-f60d16d85e77 service nova] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:42:56.970532 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8236511b-cca9-4316-ba7a-f60d16d85e77 service nova] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:42:56.970794 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8236511b-cca9-4316-ba7a-f60d16d85e77 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:42:56.978813 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8236511b-cca9-4316-ba7a-f60d16d85e77 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:42:56.980391 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8236511b-cca9-4316-ba7a-f60d16d85e77 service nova] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:42:56.989613 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 567/1133] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Oct 1 20:42:56 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 20:43:00.022703 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724d9edc-1a57-4f95-a2fb-0df4664865fc None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:43:00.023266 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724d9edc-1a57-4f95-a2fb-0df4664865fc None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:43:00.023266 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724d9edc-1a57-4f95-a2fb-0df4664865fc None None] PATH_INFO: `/v3` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:43:00.024604 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 567/1134] 10.222.0.20 () {54 vars in 925 bytes} [Sat Oct 1 20:43:00 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:43:00.030352 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9619cfac-a3f9-4698-8d6e-796707b2abd5 None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:43:00.030808 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9619cfac-a3f9-4698-8d6e-796707b2abd5 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:43:00.030926 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9619cfac-a3f9-4698-8d6e-796707b2abd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:43:00.060954 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-9619cfac-a3f9-4698-8d6e-796707b2abd5 None None] MFA Rules not processed for user `645c8f9d14a743c2b1103eec2a07c4e8`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:43:00.062152 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-9619cfac-a3f9-4698-8d6e-796707b2abd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:43:00.117844 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:43:00.128960 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 568/1135] 10.222.0.20 () {58 vars in 1015 bytes} [Sat Oct 1 20:43:00 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:43:06.773767 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=42 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:43:08.788675 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2a6dd-348a-4244-b8f1-877a8dcb690d None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:43:08.789269 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2a6dd-348a-4244-b8f1-877a8dcb690d None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:43:08.789269 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2a6dd-348a-4244-b8f1-877a8dcb690d None None] PATH_INFO: `/` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:43:08.790556 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 568/1136] 10.222.0.23 () {54 vars in 961 bytes} [Sat Oct 1 20:43:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:43:08.795576 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8599d646-4892-4922-a013-a06e4e554e2c None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:43:08.796020 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8599d646-4892-4922-a013-a06e4e554e2c None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:43:08.796168 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8599d646-4892-4922-a013-a06e4e554e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:43:08.816432 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-8599d646-4892-4922-a013-a06e4e554e2c None None] MFA Rules not processed for user `645c8f9d14a743c2b1103eec2a07c4e8`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:43:08.817676 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-8599d646-4892-4922-a013-a06e4e554e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:43:08.826147 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 569/1137] 10.222.0.23 () {58 vars in 1058 bytes} [Sat Oct 1 20:43:08 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:43:08.833530 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc2a6dd-348a-4244-b8f1-877a8dcb690d None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:43:08.847994 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc2a6dd-348a-4244-b8f1-877a8dcb690d None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:43:08.853014 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f836ad63-19ce-4980-bee3-fe9dae84bd13 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '645c8f9d14a743c2b1103eec2a07c4e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f242c4eeaa04ed19dcdc8ba95b86cfb', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:43:08.853607 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f836ad63-19ce-4980-bee3-fe9dae84bd13 service placement] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:43:08.853884 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f836ad63-19ce-4980-bee3-fe9dae84bd13 service placement] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:43:08.854150 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f836ad63-19ce-4980-bee3-fe9dae84bd13 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:43:08.863445 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f836ad63-19ce-4980-bee3-fe9dae84bd13 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:43:08.865105 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f836ad63-19ce-4980-bee3-fe9dae84bd13 service placement] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:43:08.875011 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 569/1138] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Oct 1 20:43:08 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 20:43:09.048382 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6683e77e-23c4-4e80-85dc-643b5567bb56 None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:43:09.048618 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6683e77e-23c4-4e80-85dc-643b5567bb56 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:43:09.048892 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6683e77e-23c4-4e80-85dc-643b5567bb56 None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:43:09.050202 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 570/1139] 127.0.0.1 () {54 vars in 901 bytes} [Sat Oct 1 20:43:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:43:09.054966 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a4797a-4d63-4459-8bc3-bdbb555952eb None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:43:09.055282 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a4797a-4d63-4459-8bc3-bdbb555952eb None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:43:09.055815 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a4797a-4d63-4459-8bc3-bdbb555952eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:43:09.075022 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-99a4797a-4d63-4459-8bc3-bdbb555952eb None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:43:09.076242 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-99a4797a-4d63-4459-8bc3-bdbb555952eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:43:09.085094 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 570/1140] 127.0.0.1 () {58 vars in 998 bytes} [Sat Oct 1 20:43:09 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:43:09.246920 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6683e77e-23c4-4e80-85dc-643b5567bb56 None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:43:09.261611 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6683e77e-23c4-4e80-85dc-643b5567bb56 None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:43:09.267669 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3e14f1-5d5d-4154-bb11-d96a3d35e204 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9c31d26f19d46f09e2f2e5e660234f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f242c4eeaa04ed19dcdc8ba95b86cfb', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:43:09.268259 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e14f1-5d5d-4154-bb11-d96a3d35e204 service nova] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:43:09.268555 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e14f1-5d5d-4154-bb11-d96a3d35e204 service nova] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:43:09.269036 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e14f1-5d5d-4154-bb11-d96a3d35e204 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:43:09.277465 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3e14f1-5d5d-4154-bb11-d96a3d35e204 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:43:09.279036 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3e14f1-5d5d-4154-bb11-d96a3d35e204 service nova] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:43:09.288959 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 571/1141] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Oct 1 20:43:09 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 20:43:10.924036 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2fa011-7207-4d11-9340-5b8fdf93eb19 None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:43:10.924649 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2fa011-7207-4d11-9340-5b8fdf93eb19 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:43:10.924649 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2fa011-7207-4d11-9340-5b8fdf93eb19 None None] PATH_INFO: `/` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:43:10.925943 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 571/1142] 127.0.0.1 () {54 vars in 901 bytes} [Sat Oct 1 20:43:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:43:10.931021 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe8a7b-6530-434a-903b-c163f8467d56 None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:43:10.931459 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe8a7b-6530-434a-903b-c163f8467d56 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:43:10.931569 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe8a7b-6530-434a-903b-c163f8467d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:43:10.951479 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-04fe8a7b-6530-434a-903b-c163f8467d56 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:43:10.953347 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-04fe8a7b-6530-434a-903b-c163f8467d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:43:10.961099 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 572/1143] 127.0.0.1 () {58 vars in 998 bytes} [Sat Oct 1 20:43:10 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:43:11.123960 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2fa011-7207-4d11-9340-5b8fdf93eb19 None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:43:11.138122 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2fa011-7207-4d11-9340-5b8fdf93eb19 None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:43:11.144053 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7bf44d-35b5-4a5f-9534-df2cacac0d7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9c31d26f19d46f09e2f2e5e660234f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f242c4eeaa04ed19dcdc8ba95b86cfb', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:43:11.144669 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7bf44d-35b5-4a5f-9534-df2cacac0d7a service nova] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:43:11.144948 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7bf44d-35b5-4a5f-9534-df2cacac0d7a service nova] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:43:11.145217 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7bf44d-35b5-4a5f-9534-df2cacac0d7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:43:11.153064 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7bf44d-35b5-4a5f-9534-df2cacac0d7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:43:11.154656 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7bf44d-35b5-4a5f-9534-df2cacac0d7a service nova] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:43:11.164456 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 572/1144] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Oct 1 20:43:11 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 20:43:15.565929 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3f76c-3c6a-4ce5-8b7e-8911ecb53149 None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:43:15.566494 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3f76c-3c6a-4ce5-8b7e-8911ecb53149 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:43:15.566494 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3f76c-3c6a-4ce5-8b7e-8911ecb53149 None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:43:15.567827 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 573/1145] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 1 20:43:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:43:15.573051 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7488c70-47ec-4ea6-8d31-bc03fde44d4f None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:43:15.573504 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7488c70-47ec-4ea6-8d31-bc03fde44d4f None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:43:15.573600 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7488c70-47ec-4ea6-8d31-bc03fde44d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:43:15.593465 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-d7488c70-47ec-4ea6-8d31-bc03fde44d4f None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:43:15.594656 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-d7488c70-47ec-4ea6-8d31-bc03fde44d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:43:15.602417 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 573/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 1 20:43:15 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:43:15.946600 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b3f76c-3c6a-4ce5-8b7e-8911ecb53149 None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:43:15.948402 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-a9b3f76c-3c6a-4ce5-8b7e-8911ecb53149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:43:16.009239 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b3f76c-3c6a-4ce5-8b7e-8911ecb53149 None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:43:16.012741 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a01142-a4d1-41f8-9a36-af964964af29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd498314742474614b90a1350359f506a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f242c4eeaa04ed19dcdc8ba95b86cfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:43:16.013358 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a01142-a4d1-41f8-9a36-af964964af29 service neutron] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:43:16.013618 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a01142-a4d1-41f8-9a36-af964964af29 service neutron] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:43:16.013887 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a01142-a4d1-41f8-9a36-af964964af29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:43:16.022659 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a01142-a4d1-41f8-9a36-af964964af29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:43:16.024090 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a01142-a4d1-41f8-9a36-af964964af29 service neutron] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:43:16.033789 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 574/1147] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Oct 1 20:43:15 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 20:43:18.464600 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da3466-5f5f-4bf4-8eb8-9f4bfe704c7a None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:43:18.465153 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da3466-5f5f-4bf4-8eb8-9f4bfe704c7a None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:43:18.465153 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da3466-5f5f-4bf4-8eb8-9f4bfe704c7a None None] PATH_INFO: `/` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:43:18.466541 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 574/1148] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 1 20:43:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:43:18.472469 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab158f-2393-4e39-bf97-9bb8c1a65242 None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:43:18.472957 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab158f-2393-4e39-bf97-9bb8c1a65242 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:43:18.473056 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab158f-2393-4e39-bf97-9bb8c1a65242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:43:18.493010 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-03ab158f-2393-4e39-bf97-9bb8c1a65242 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:43:18.494194 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-03ab158f-2393-4e39-bf97-9bb8c1a65242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:43:18.502008 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 575/1149] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 1 20:43:18 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:43:18.844209 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72da3466-5f5f-4bf4-8eb8-9f4bfe704c7a None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:43:18.845934 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-72da3466-5f5f-4bf4-8eb8-9f4bfe704c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:43:18.858641 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72da3466-5f5f-4bf4-8eb8-9f4bfe704c7a None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:43:18.862104 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c58b61a-885b-4cad-8606-d2f2348a2530 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd498314742474614b90a1350359f506a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f242c4eeaa04ed19dcdc8ba95b86cfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:43:18.862692 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c58b61a-885b-4cad-8606-d2f2348a2530 service neutron] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:43:18.862968 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c58b61a-885b-4cad-8606-d2f2348a2530 service neutron] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:43:18.863239 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c58b61a-885b-4cad-8606-d2f2348a2530 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:43:18.872155 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c58b61a-885b-4cad-8606-d2f2348a2530 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:43:18.873614 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c58b61a-885b-4cad-8606-d2f2348a2530 service neutron] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:43:18.882857 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 575/1150] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Oct 1 20:43:18 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 01 20:43:22.852549 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9beccd4-56d6-4700-83ca-0b8ed13e1174 None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:43:22.853125 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9beccd4-56d6-4700-83ca-0b8ed13e1174 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:43:22.853125 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9beccd4-56d6-4700-83ca-0b8ed13e1174 None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:43:22.854428 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 576/1151] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 1 20:43:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:43:22.859698 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4547266e-5a0b-42ba-b8b1-c617381d4b2c None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:43:22.860143 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4547266e-5a0b-42ba-b8b1-c617381d4b2c None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:43:22.860242 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4547266e-5a0b-42ba-b8b1-c617381d4b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:43:22.879722 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-4547266e-5a0b-42ba-b8b1-c617381d4b2c None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:43:22.880944 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-4547266e-5a0b-42ba-b8b1-c617381d4b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:43:22.888580 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 576/1152] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 1 20:43:22 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:43:23.239392 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9beccd4-56d6-4700-83ca-0b8ed13e1174 None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:43:23.241144 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-f9beccd4-56d6-4700-83ca-0b8ed13e1174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:43:23.312421 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9beccd4-56d6-4700-83ca-0b8ed13e1174 None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:43:23.315912 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba6d630-e7a2-441d-ab4e-6ece06d70db8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b737fe6e9f34adf8eef1851a4a89ca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f242c4eeaa04ed19dcdc8ba95b86cfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:43:23.316506 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6d630-e7a2-441d-ab4e-6ece06d70db8 service cinder] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:43:23.316810 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6d630-e7a2-441d-ab4e-6ece06d70db8 service cinder] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:43:23.317079 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6d630-e7a2-441d-ab4e-6ece06d70db8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:43:23.325779 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba6d630-e7a2-441d-ab4e-6ece06d70db8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:43:23.328119 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba6d630-e7a2-441d-ab4e-6ece06d70db8 service cinder] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:43:23.337570 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 577/1153] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Oct 1 20:43:23 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 20:43:25.745337 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5ce0a2-ba7f-427f-94cd-41a50f98f0cd None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:43:25.745899 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5ce0a2-ba7f-427f-94cd-41a50f98f0cd None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:43:25.745899 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5ce0a2-ba7f-427f-94cd-41a50f98f0cd None None] PATH_INFO: `/` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:43:25.747221 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 577/1154] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 1 20:43:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:43:25.753431 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d8eae2-85af-4648-83b8-1adbdeaab173 None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:43:25.753887 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d8eae2-85af-4648-83b8-1adbdeaab173 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:43:25.753998 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d8eae2-85af-4648-83b8-1adbdeaab173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:43:25.772962 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-d6d8eae2-85af-4648-83b8-1adbdeaab173 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:43:25.774141 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-d6d8eae2-85af-4648-83b8-1adbdeaab173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:43:25.782263 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 578/1155] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 1 20:43:25 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:43:26.144755 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5ce0a2-ba7f-427f-94cd-41a50f98f0cd None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:43:26.146403 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-bd5ce0a2-ba7f-427f-94cd-41a50f98f0cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:43:26.159750 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5ce0a2-ba7f-427f-94cd-41a50f98f0cd None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:43:26.163252 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1a1dac-8471-44ac-aa6f-26f8c06fe4bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b737fe6e9f34adf8eef1851a4a89ca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f242c4eeaa04ed19dcdc8ba95b86cfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:43:26.163840 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1a1dac-8471-44ac-aa6f-26f8c06fe4bc service cinder] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:43:26.164111 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1a1dac-8471-44ac-aa6f-26f8c06fe4bc service cinder] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:43:26.164379 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1a1dac-8471-44ac-aa6f-26f8c06fe4bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:43:26.174074 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1a1dac-8471-44ac-aa6f-26f8c06fe4bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:43:26.175497 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1a1dac-8471-44ac-aa6f-26f8c06fe4bc service cinder] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:43:26.185036 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 578/1156] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Oct 1 20:43:26 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 20:43:35.768275 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=75 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:43:36.180954 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=33 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:44:41.707815 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad82a185-52e9-4544-bcb5-161132b86333 None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:44:41.708462 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad82a185-52e9-4544-bcb5-161132b86333 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:44:41.708462 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad82a185-52e9-4544-bcb5-161132b86333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:44:41.728170 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-ad82a185-52e9-4544-bcb5-161132b86333 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:44:41.729435 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-ad82a185-52e9-4544-bcb5-161132b86333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:44:41.738181 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 579/1157] 10.222.0.23 () {58 vars in 958 bytes} [Sat Oct 1 20:44:41 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:44:41.744166 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd6ad11-8f4d-403c-94fc-7b9bf2e62875 None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:44:41.744773 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd6ad11-8f4d-403c-94fc-7b9bf2e62875 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:44:41.744982 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd6ad11-8f4d-403c-94fc-7b9bf2e62875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:44:41.746074 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6099d8-d4ce-4c13-b1e0-5bc8a0060e46 None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:44:41.746361 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6099d8-d4ce-4c13-b1e0-5bc8a0060e46 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:44:41.746635 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6099d8-d4ce-4c13-b1e0-5bc8a0060e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:44:41.764367 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-4dd6ad11-8f4d-403c-94fc-7b9bf2e62875 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:44:41.765632 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-4dd6ad11-8f4d-403c-94fc-7b9bf2e62875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:44:41.766464 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-cf6099d8-d4ce-4c13-b1e0-5bc8a0060e46 None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:44:41.767628 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-cf6099d8-d4ce-4c13-b1e0-5bc8a0060e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:44:41.773371 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 579/1158] 10.222.0.23 () {58 vars in 958 bytes} [Sat Oct 1 20:44:41 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:44:41.775459 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 580/1159] 10.222.0.23 () {58 vars in 958 bytes} [Sat Oct 1 20:44:41 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 01 20:44:41.781260 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd6ad11-8f4d-403c-94fc-7b9bf2e62875 None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:44:41.782467 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac2622-e32a-4ee2-a240-8b95dd46ae0e None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:44:41.782759 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac2622-e32a-4ee2-a240-8b95dd46ae0e None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:44:41.783035 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac2622-e32a-4ee2-a240-8b95dd46ae0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:44:41.791025 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd6ad11-8f4d-403c-94fc-7b9bf2e62875 None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:44:41.797065 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d331b4-dc65-4699-a64d-0761fb2b0b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f2619d8f534f3eace3cce529462560', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:44:41.798067 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d331b4-dc65-4699-a64d-0761fb2b0b07 admin admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:44:41.798368 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d331b4-dc65-4699-a64d-0761fb2b0b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:44:41.798639 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d331b4-dc65-4699-a64d-0761fb2b0b07 admin admin] PATH_INFO: `/v3/domains` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:44:41.799272 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d331b4-dc65-4699-a64d-0761fb2b0b07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=94756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:44:41.799566 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d331b4-dc65-4699-a64d-0761fb2b0b07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:44:41.800602 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: WARNING py.warnings [None req-e5d331b4-dc65-4699-a64d-0761fb2b0b07 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 01 20:44:41.800602 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: warnings.warn(msg) Oct 01 20:44:41.800602 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: Oct 01 20:44:41.801486 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d331b4-dc65-4699-a64d-0761fb2b0b07 admin admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:44:41.803033 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-81ac2622-e32a-4ee2-a240-8b95dd46ae0e None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:44:41.804488 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-81ac2622-e32a-4ee2-a240-8b95dd46ae0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:44:41.812843 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 581/1160] 10.222.0.23 () {58 vars in 958 bytes} [Sat Oct 1 20:44:41 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 01 20:44:41.820096 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 580/1161] 10.222.0.23 () {58 vars in 1153 bytes} [Sat Oct 1 20:44:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 20:44:41.820265 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ac2622-e32a-4ee2-a240-8b95dd46ae0e None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:44:41.821505 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d331b4-dc65-4699-a64d-0761fb2b0b07 admin admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:44:41.827526 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ac2622-e32a-4ee2-a240-8b95dd46ae0e None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:44:41.831187 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d331b4-dc65-4699-a64d-0761fb2b0b07 admin admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:44:41.832098 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6015ba1c-3e27-440f-8e9c-6fcadadb69e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f2619d8f534f3eace3cce529462560', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:44:41.832721 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6015ba1c-3e27-440f-8e9c-6fcadadb69e0 admin admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:44:41.833001 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6015ba1c-3e27-440f-8e9c-6fcadadb69e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:44:41.833271 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6015ba1c-3e27-440f-8e9c-6fcadadb69e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:44:41.833902 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6015ba1c-3e27-440f-8e9c-6fcadadb69e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=94755) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 20:44:41.834201 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6015ba1c-3e27-440f-8e9c-6fcadadb69e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:44:41.835799 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6015ba1c-3e27-440f-8e9c-6fcadadb69e0 admin admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:44:41.835904 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bbefe4-c0ce-475c-8808-99d77b7c55b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f2619d8f534f3eace3cce529462560', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:44:41.836430 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bbefe4-c0ce-475c-8808-99d77b7c55b5 admin admin] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:44:41.836749 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bbefe4-c0ce-475c-8808-99d77b7c55b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:44:41.837021 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bbefe4-c0ce-475c-8808-99d77b7c55b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:44:41.837911 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bbefe4-c0ce-475c-8808-99d77b7c55b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:44:41.840296 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bbefe4-c0ce-475c-8808-99d77b7c55b5 admin admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:44:41.848912 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 582/1162] 10.222.0.23 () {58 vars in 1153 bytes} [Sat Oct 1 20:44:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 20:44:41.858073 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6015ba1c-3e27-440f-8e9c-6fcadadb69e0 admin admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:44:41.867629 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6015ba1c-3e27-440f-8e9c-6fcadadb69e0 admin admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:44:41.873054 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f30fba-d832-4e09-a44c-1ef68f5f93aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f2619d8f534f3eace3cce529462560', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:44:41.873639 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f30fba-d832-4e09-a44c-1ef68f5f93aa admin admin] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:44:41.873916 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f30fba-d832-4e09-a44c-1ef68f5f93aa admin admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:44:41.874185 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f30fba-d832-4e09-a44c-1ef68f5f93aa admin admin] PATH_INFO: `/v3/projects` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:44:41.874797 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f30fba-d832-4e09-a44c-1ef68f5f93aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:44:41.875826 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: WARNING py.warnings [None req-d9f30fba-d832-4e09-a44c-1ef68f5f93aa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 01 20:44:41.875826 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: warnings.warn(msg) Oct 01 20:44:41.875826 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: Oct 01 20:44:41.877091 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f30fba-d832-4e09-a44c-1ef68f5f93aa admin admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:44:41.879308 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 581/1163] 10.222.0.23 () {60 vars in 1153 bytes} [Sat Oct 1 20:44:41 2022] POST /identity/v3/projects => generated 379 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 01 20:44:41.883307 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bbefe4-c0ce-475c-8808-99d77b7c55b5 admin admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:44:41.909834 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 583/1164] 10.222.0.23 () {60 vars in 1153 bytes} [Sat Oct 1 20:44:41 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 20:44:41.913848 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f30fba-d832-4e09-a44c-1ef68f5f93aa admin admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:44:41.950080 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bbefe4-c0ce-475c-8808-99d77b7c55b5 admin admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:44:41.978008 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f30fba-d832-4e09-a44c-1ef68f5f93aa admin admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:44:41.982565 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811944a8-cc3c-46fb-9219-cad2b60c1587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f2619d8f534f3eace3cce529462560', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:44:41.983171 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811944a8-cc3c-46fb-9219-cad2b60c1587 admin admin] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:44:41.983443 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811944a8-cc3c-46fb-9219-cad2b60c1587 admin admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:44:41.983710 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811944a8-cc3c-46fb-9219-cad2b60c1587 admin admin] PATH_INFO: `/v3/users` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:44:41.984330 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811944a8-cc3c-46fb-9219-cad2b60c1587 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:44:41.986435 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811944a8-cc3c-46fb-9219-cad2b60c1587 admin admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:44:42.008028 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 584/1165] 10.222.0.23 () {60 vars in 1144 bytes} [Sat Oct 1 20:44:41 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 01 20:44:42.010413 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb0182b-b93d-412e-9cd0-9c621353635e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f2619d8f534f3eace3cce529462560', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:44:42.011147 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb0182b-b93d-412e-9cd0-9c621353635e admin admin] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:44:42.011430 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb0182b-b93d-412e-9cd0-9c621353635e admin admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:44:42.011701 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb0182b-b93d-412e-9cd0-9c621353635e admin admin] PATH_INFO: `/v3/users` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:44:42.011836 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811944a8-cc3c-46fb-9219-cad2b60c1587 admin admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:44:42.012323 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb0182b-b93d-412e-9cd0-9c621353635e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:44:42.013932 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: WARNING py.warnings [None req-cfb0182b-b93d-412e-9cd0-9c621353635e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 01 20:44:42.013932 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: warnings.warn(msg) Oct 01 20:44:42.013932 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: Oct 01 20:44:42.015150 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb0182b-b93d-412e-9cd0-9c621353635e admin admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:44:42.021782 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811944a8-cc3c-46fb-9219-cad2b60c1587 admin admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:44:42.027574 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad30e98b-4b5c-493f-b22f-9201f14888ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f2619d8f534f3eace3cce529462560', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:44:42.029055 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad30e98b-4b5c-493f-b22f-9201f14888ec admin admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:44:42.029423 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad30e98b-4b5c-493f-b22f-9201f14888ec admin admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:44:42.029807 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad30e98b-4b5c-493f-b22f-9201f14888ec admin admin] PATH_INFO: `/v3/roles` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:44:42.030447 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad30e98b-4b5c-493f-b22f-9201f14888ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:44:42.032282 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad30e98b-4b5c-493f-b22f-9201f14888ec admin admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:44:42.037589 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 582/1166] 10.222.0.23 () {60 vars in 1144 bytes} [Sat Oct 1 20:44:41 2022] POST /identity/v3/users => generated 290 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 01 20:44:42.041322 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb0182b-b93d-412e-9cd0-9c621353635e admin admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:44:42.045852 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 585/1167] 10.222.0.23 () {58 vars in 1122 bytes} [Sat Oct 1 20:44:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 01 20:44:42.046794 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad30e98b-4b5c-493f-b22f-9201f14888ec admin admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:44:42.051163 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb0182b-b93d-412e-9cd0-9c621353635e admin admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:44:42.056407 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad30e98b-4b5c-493f-b22f-9201f14888ec admin admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:44:42.056673 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159db8f2-7d36-4948-a26d-14137e265f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f2619d8f534f3eace3cce529462560', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:44:42.057262 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159db8f2-7d36-4948-a26d-14137e265f7b admin admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:44:42.057540 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159db8f2-7d36-4948-a26d-14137e265f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:44:42.057807 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159db8f2-7d36-4948-a26d-14137e265f7b admin admin] PATH_INFO: `/v3/roles` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:44:42.058436 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159db8f2-7d36-4948-a26d-14137e265f7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:44:42.060381 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159db8f2-7d36-4948-a26d-14137e265f7b admin admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:44:42.061636 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66a59ed-10fb-4767-ad38-29ce883a0b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f2619d8f534f3eace3cce529462560', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:44:42.062204 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a59ed-10fb-4767-ad38-29ce883a0b4c admin admin] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:44:42.062477 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a59ed-10fb-4767-ad38-29ce883a0b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:44:42.062744 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a59ed-10fb-4767-ad38-29ce883a0b4c admin admin] PATH_INFO: `/v3/roles` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:44:42.063358 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66a59ed-10fb-4767-ad38-29ce883a0b4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:44:42.064976 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66a59ed-10fb-4767-ad38-29ce883a0b4c admin admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:44:42.071117 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 583/1168] 10.222.0.23 () {58 vars in 1122 bytes} [Sat Oct 1 20:44:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 01 20:44:42.075004 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159db8f2-7d36-4948-a26d-14137e265f7b admin admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:44:42.076192 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 586/1169] 10.222.0.23 () {58 vars in 1122 bytes} [Sat Oct 1 20:44:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 01 20:44:42.079754 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66a59ed-10fb-4767-ad38-29ce883a0b4c admin admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:44:42.086263 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159db8f2-7d36-4948-a26d-14137e265f7b admin admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:44:42.089092 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66a59ed-10fb-4767-ad38-29ce883a0b4c admin admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:44:42.091437 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f1fb99-08c6-4948-85d7-58fdee8d8905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f2619d8f534f3eace3cce529462560', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:44:42.092112 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1fb99-08c6-4948-85d7-58fdee8d8905 admin admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:44:42.092389 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1fb99-08c6-4948-85d7-58fdee8d8905 admin admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:44:42.092700 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1fb99-08c6-4948-85d7-58fdee8d8905 admin admin] PATH_INFO: `/v3/roles` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:44:42.093327 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f1fb99-08c6-4948-85d7-58fdee8d8905 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:44:42.094729 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6915ed1-4d0a-4240-b8ef-d976e6eab69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f2619d8f534f3eace3cce529462560', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:44:42.094950 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f1fb99-08c6-4948-85d7-58fdee8d8905 admin admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:44:42.095361 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6915ed1-4d0a-4240-b8ef-d976e6eab69d admin admin] REQUEST_METHOD: `PUT` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:44:42.095637 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6915ed1-4d0a-4240-b8ef-d976e6eab69d admin admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:44:42.095908 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6915ed1-4d0a-4240-b8ef-d976e6eab69d admin admin] PATH_INFO: `/v3/projects/374fe0ae6ee448c9879a8266e51a3606/users/bbfba81504d14188aa392affce459462/roles/82138515a02147ccb30f8d56863aab87` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:44:42.107696 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 584/1170] 10.222.0.23 () {58 vars in 1122 bytes} [Sat Oct 1 20:44:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 20:44:42.111868 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f1fb99-08c6-4948-85d7-58fdee8d8905 admin admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:44:42.112295 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6915ed1-4d0a-4240-b8ef-d976e6eab69d admin admin] RBAC: Authorizing `identity:create_grant(project_id=374fe0ae6ee448c9879a8266e51a3606, user_id=bbfba81504d14188aa392affce459462, role_id=82138515a02147ccb30f8d56863aab87)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:44:42.113378 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: WARNING py.warnings [None req-d6915ed1-4d0a-4240-b8ef-d976e6eab69d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 01 20:44:42.113378 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: warnings.warn(msg) Oct 01 20:44:42.113378 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: Oct 01 20:44:42.115303 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6915ed1-4d0a-4240-b8ef-d976e6eab69d admin admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:44:42.121169 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f1fb99-08c6-4948-85d7-58fdee8d8905 admin admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:44:42.126435 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67da9cb7-8676-4000-9d63-2e86f9577caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f2619d8f534f3eace3cce529462560', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:44:42.127078 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da9cb7-8676-4000-9d63-2e86f9577caf admin admin] REQUEST_METHOD: `PUT` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:44:42.127355 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da9cb7-8676-4000-9d63-2e86f9577caf admin admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:44:42.127629 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da9cb7-8676-4000-9d63-2e86f9577caf admin admin] PATH_INFO: `/v3/projects/ad6c25c90ba74647a7f4f821efe12045/users/f1645806dcdd41ea9c174bd4a9551899/roles/82138515a02147ccb30f8d56863aab87` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:44:42.128138 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 587/1171] 10.222.0.23 () {60 vars in 1483 bytes} [Sat Oct 1 20:44:42 2022] PUT /identity/v3/projects/374fe0ae6ee448c9879a8266e51a3606/users/bbfba81504d14188aa392affce459462/roles/82138515a02147ccb30f8d56863aab87 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 01 20:44:42.133098 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353bcc0e-0f0c-40de-8116-e0a8d211081a None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:44:42.133380 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353bcc0e-0f0c-40de-8116-e0a8d211081a None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:44:42.133827 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353bcc0e-0f0c-40de-8116-e0a8d211081a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:44:42.143003 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67da9cb7-8676-4000-9d63-2e86f9577caf admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad6c25c90ba74647a7f4f821efe12045, user_id=f1645806dcdd41ea9c174bd4a9551899, role_id=82138515a02147ccb30f8d56863aab87)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:44:42.145705 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67da9cb7-8676-4000-9d63-2e86f9577caf admin admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:44:42.152442 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-353bcc0e-0f0c-40de-8116-e0a8d211081a None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:44:42.154930 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-353bcc0e-0f0c-40de-8116-e0a8d211081a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:44:42.162108 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 585/1172] 10.222.0.23 () {60 vars in 1483 bytes} [Sat Oct 1 20:44:42 2022] PUT /identity/v3/projects/ad6c25c90ba74647a7f4f821efe12045/users/f1645806dcdd41ea9c174bd4a9551899/roles/82138515a02147ccb30f8d56863aab87 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 01 20:44:42.162425 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:44:42.167204 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc65754-1600-4b67-8b55-219bd3bb93ce None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:44:42.167785 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc65754-1600-4b67-8b55-219bd3bb93ce None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:44:42.168298 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc65754-1600-4b67-8b55-219bd3bb93ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:44:42.190649 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-8fc65754-1600-4b67-8b55-219bd3bb93ce None None] MFA Rules not processed for user `6d59f4f70f764f57b1d8cf05402fdf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:44:42.191870 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-8fc65754-1600-4b67-8b55-219bd3bb93ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:44:42.214013 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:44:42.230565 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 588/1173] 10.222.0.23 () {58 vars in 958 bytes} [Sat Oct 1 20:44:42 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 01 20:44:42.240604 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353bcc0e-0f0c-40de-8116-e0a8d211081a None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:44:42.252926 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 586/1174] 10.222.0.23 () {58 vars in 958 bytes} [Sat Oct 1 20:44:42 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 01 20:44:42.261906 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc65754-1600-4b67-8b55-219bd3bb93ce None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:44:42.298642 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353bcc0e-0f0c-40de-8116-e0a8d211081a None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:44:42.302364 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f1dc8-71f6-432d-b5be-d7e27ca89b82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd498314742474614b90a1350359f506a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f242c4eeaa04ed19dcdc8ba95b86cfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:44:42.302960 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f1dc8-71f6-432d-b5be-d7e27ca89b82 service neutron] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:44:42.303239 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f1dc8-71f6-432d-b5be-d7e27ca89b82 service neutron] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:44:42.303875 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f1dc8-71f6-432d-b5be-d7e27ca89b82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:44:42.313986 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162f1dc8-71f6-432d-b5be-d7e27ca89b82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:44:42.315411 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162f1dc8-71f6-432d-b5be-d7e27ca89b82 service neutron] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:44:42.316094 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc65754-1600-4b67-8b55-219bd3bb93ce None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:44:42.319721 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca7c021-5fbd-4fc6-bf0f-bdd04150ad9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd498314742474614b90a1350359f506a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f242c4eeaa04ed19dcdc8ba95b86cfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:44:42.320320 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7c021-5fbd-4fc6-bf0f-bdd04150ad9e service neutron] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:44:42.320698 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7c021-5fbd-4fc6-bf0f-bdd04150ad9e service neutron] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:44:42.320974 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7c021-5fbd-4fc6-bf0f-bdd04150ad9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:44:42.324685 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 589/1175] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Oct 1 20:44:42 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 01 20:44:42.334055 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca7c021-5fbd-4fc6-bf0f-bdd04150ad9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:44:42.335485 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca7c021-5fbd-4fc6-bf0f-bdd04150ad9e service neutron] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:44:42.346069 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 587/1176] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Oct 1 20:44:42 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 01 20:44:47.504686 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fabdef-a13d-4f08-bcd2-ff9c5b3d3ab4 None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:44:47.505276 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fabdef-a13d-4f08-bcd2-ff9c5b3d3ab4 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:44:47.505276 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fabdef-a13d-4f08-bcd2-ff9c5b3d3ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:44:47.562382 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-71fabdef-a13d-4f08-bcd2-ff9c5b3d3ab4 None None] MFA Rules not processed for user `bbfba81504d14188aa392affce459462`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:44:47.564380 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-71fabdef-a13d-4f08-bcd2-ff9c5b3d3ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:44:47.651656 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 590/1177] 10.222.0.23 () {58 vars in 958 bytes} [Sat Oct 1 20:44:47 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:44:47.656616 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca7c021-5fbd-4fc6-bf0f-bdd04150ad9e service neutron] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:44:47.666826 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca7c021-5fbd-4fc6-bf0f-bdd04150ad9e service neutron] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:44:47.679279 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16b750e-e213-4c83-8c5f-ec83c81f16da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f2619d8f534f3eace3cce529462560', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:44:47.680367 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b750e-e213-4c83-8c5f-ec83c81f16da admin admin] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:44:47.680367 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b750e-e213-4c83-8c5f-ec83c81f16da admin admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:44:47.680590 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b750e-e213-4c83-8c5f-ec83c81f16da admin admin] PATH_INFO: `/v3/projects` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:44:47.681260 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16b750e-e213-4c83-8c5f-ec83c81f16da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:44:47.683230 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16b750e-e213-4c83-8c5f-ec83c81f16da admin admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:44:47.749999 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 588/1178] 10.222.0.23 () {60 vars in 1153 bytes} [Sat Oct 1 20:44:47 2022] POST /identity/v3/projects => generated 385 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 20:44:47.751016 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fabdef-a13d-4f08-bcd2-ff9c5b3d3ab4 None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:44:47.767580 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fabdef-a13d-4f08-bcd2-ff9c5b3d3ab4 None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:44:47.836961 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbd27df-e4b7-4403-8784-86387c399608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f2619d8f534f3eace3cce529462560', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:44:47.837581 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd27df-e4b7-4403-8784-86387c399608 admin admin] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:44:47.837859 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd27df-e4b7-4403-8784-86387c399608 admin admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:44:47.838140 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd27df-e4b7-4403-8784-86387c399608 admin admin] PATH_INFO: `/v3/users` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:44:47.838777 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbd27df-e4b7-4403-8784-86387c399608 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:44:47.841354 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbd27df-e4b7-4403-8784-86387c399608 admin admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:44:47.873464 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 591/1179] 10.222.0.23 () {60 vars in 1144 bytes} [Sat Oct 1 20:44:47 2022] POST /identity/v3/users => generated 299 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 20:44:47.874337 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16b750e-e213-4c83-8c5f-ec83c81f16da admin admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:44:47.888293 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16b750e-e213-4c83-8c5f-ec83c81f16da admin admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:44:47.894388 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0af48cc-bb4d-486f-904c-09cef1705835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f2619d8f534f3eace3cce529462560', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:44:47.894796 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af48cc-bb4d-486f-904c-09cef1705835 admin admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:44:47.895134 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af48cc-bb4d-486f-904c-09cef1705835 admin admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:44:47.895477 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af48cc-bb4d-486f-904c-09cef1705835 admin admin] PATH_INFO: `/v3/roles` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:44:47.896446 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0af48cc-bb4d-486f-904c-09cef1705835 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:44:47.916322 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0af48cc-bb4d-486f-904c-09cef1705835 admin admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:44:47.937883 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbd27df-e4b7-4403-8784-86387c399608 admin admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:44:47.945373 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 589/1180] 10.222.0.23 () {58 vars in 1122 bytes} [Sat Oct 1 20:44:47 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 01 20:44:47.949438 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbd27df-e4b7-4403-8784-86387c399608 admin admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:44:47.956607 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfed86d2-b331-4512-a09f-18b13e56579d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f2619d8f534f3eace3cce529462560', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:44:47.957881 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed86d2-b331-4512-a09f-18b13e56579d admin admin] REQUEST_METHOD: `PUT` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:44:47.958238 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed86d2-b331-4512-a09f-18b13e56579d admin admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:44:47.958586 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed86d2-b331-4512-a09f-18b13e56579d admin admin] PATH_INFO: `/v3/projects/3a6fa10149514c23b6ccf2136ed045be/users/fd0e2d3f911147ac9b374eaf22ea1dff/roles/d11e7ba2f1fa41ff8ea8dda2a8d1466f` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:44:47.985158 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:44:47.996191 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfed86d2-b331-4512-a09f-18b13e56579d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a6fa10149514c23b6ccf2136ed045be, user_id=fd0e2d3f911147ac9b374eaf22ea1dff, role_id=d11e7ba2f1fa41ff8ea8dda2a8d1466f)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:44:47.999826 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfed86d2-b331-4512-a09f-18b13e56579d admin admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:44:48.039629 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 592/1181] 10.222.0.23 () {60 vars in 1483 bytes} [Sat Oct 1 20:44:47 2022] PUT /identity/v3/projects/3a6fa10149514c23b6ccf2136ed045be/users/fd0e2d3f911147ac9b374eaf22ea1dff/roles/d11e7ba2f1fa41ff8ea8dda2a8d1466f => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 20:44:48.043513 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0af48cc-bb4d-486f-904c-09cef1705835 admin admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:44:48.056665 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0af48cc-bb4d-486f-904c-09cef1705835 admin admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:44:48.150458 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fecf69-f589-4984-a3be-de2e19e094b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f2619d8f534f3eace3cce529462560', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:44:48.151282 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fecf69-f589-4984-a3be-de2e19e094b1 admin admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:44:48.151568 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fecf69-f589-4984-a3be-de2e19e094b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:44:48.151865 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fecf69-f589-4984-a3be-de2e19e094b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:44:48.152512 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fecf69-f589-4984-a3be-de2e19e094b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:44:48.157126 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fecf69-f589-4984-a3be-de2e19e094b1 admin admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:44:48.158396 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c78aebd-fc5d-43e3-b7d8-71fb7cd572c9 None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:44:48.158859 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c78aebd-fc5d-43e3-b7d8-71fb7cd572c9 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:44:48.158971 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c78aebd-fc5d-43e3-b7d8-71fb7cd572c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:44:48.179677 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 590/1182] 10.222.0.23 () {58 vars in 1122 bytes} [Sat Oct 1 20:44:48 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 20:44:48.184234 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fecf69-f589-4984-a3be-de2e19e094b1 admin admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:44:48.196787 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fecf69-f589-4984-a3be-de2e19e094b1 admin admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:44:48.199400 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-9c78aebd-fc5d-43e3-b7d8-71fb7cd572c9 None None] MFA Rules not processed for user `f1645806dcdd41ea9c174bd4a9551899`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:44:48.201674 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-9c78aebd-fc5d-43e3-b7d8-71fb7cd572c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:44:48.202846 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c045948-43b8-4c60-b906-4a9229905f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f2619d8f534f3eace3cce529462560', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:44:48.203507 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c045948-43b8-4c60-b906-4a9229905f62 admin admin] REQUEST_METHOD: `PUT` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:44:48.203782 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c045948-43b8-4c60-b906-4a9229905f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:44:48.204053 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c045948-43b8-4c60-b906-4a9229905f62 admin admin] PATH_INFO: `/v3/projects/3a6fa10149514c23b6ccf2136ed045be/users/fd0e2d3f911147ac9b374eaf22ea1dff/roles/d11e7ba2f1fa41ff8ea8dda2a8d1466f` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:44:48.206079 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c045948-43b8-4c60-b906-4a9229905f62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a6fa10149514c23b6ccf2136ed045be, user_id=fd0e2d3f911147ac9b374eaf22ea1dff, role_id=d11e7ba2f1fa41ff8ea8dda2a8d1466f)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:44:48.210959 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c045948-43b8-4c60-b906-4a9229905f62 admin admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:44:48.214805 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:44:48.227192 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 591/1183] 10.222.0.23 () {60 vars in 1483 bytes} [Sat Oct 1 20:44:48 2022] PUT /identity/v3/projects/3a6fa10149514c23b6ccf2136ed045be/users/fd0e2d3f911147ac9b374eaf22ea1dff/roles/d11e7ba2f1fa41ff8ea8dda2a8d1466f => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 01 20:44:48.292839 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 593/1184] 10.222.0.23 () {58 vars in 958 bytes} [Sat Oct 1 20:44:48 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:44:48.295481 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c045948-43b8-4c60-b906-4a9229905f62 admin admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:44:48.436497 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c045948-43b8-4c60-b906-4a9229905f62 admin admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:44:48.447377 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdc0160-2086-4afe-90f6-149e55c0afab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f2619d8f534f3eace3cce529462560', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:44:48.448371 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc0160-2086-4afe-90f6-149e55c0afab admin admin] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:44:48.449178 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc0160-2086-4afe-90f6-149e55c0afab admin admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:44:48.449619 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc0160-2086-4afe-90f6-149e55c0afab admin admin] PATH_INFO: `/v3/projects` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:44:48.450570 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdc0160-2086-4afe-90f6-149e55c0afab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:44:48.452816 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdc0160-2086-4afe-90f6-149e55c0afab admin admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:44:48.511546 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 592/1185] 10.222.0.23 () {60 vars in 1153 bytes} [Sat Oct 1 20:44:48 2022] POST /identity/v3/projects => generated 379 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 20:44:48.516159 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c78aebd-fc5d-43e3-b7d8-71fb7cd572c9 None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:44:48.551330 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c78aebd-fc5d-43e3-b7d8-71fb7cd572c9 None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:44:48.625028 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebf09ad-5082-4aa3-8086-0d3d8ff808cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f2619d8f534f3eace3cce529462560', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:44:48.626059 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf09ad-5082-4aa3-8086-0d3d8ff808cc admin admin] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:44:48.626963 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf09ad-5082-4aa3-8086-0d3d8ff808cc admin admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:44:48.627462 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf09ad-5082-4aa3-8086-0d3d8ff808cc admin admin] PATH_INFO: `/v3/users` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:44:48.628461 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebf09ad-5082-4aa3-8086-0d3d8ff808cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:44:48.630861 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebf09ad-5082-4aa3-8086-0d3d8ff808cc admin admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:44:48.663306 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 594/1186] 10.222.0.23 () {60 vars in 1144 bytes} [Sat Oct 1 20:44:48 2022] POST /identity/v3/users => generated 296 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 20:44:48.664484 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdc0160-2086-4afe-90f6-149e55c0afab admin admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:44:48.677202 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdc0160-2086-4afe-90f6-149e55c0afab admin admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:44:48.693339 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686a7524-9d80-4e9e-974a-369e6d04a335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f2619d8f534f3eace3cce529462560', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:44:48.693944 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686a7524-9d80-4e9e-974a-369e6d04a335 admin admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:44:48.694227 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686a7524-9d80-4e9e-974a-369e6d04a335 admin admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:44:48.694675 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686a7524-9d80-4e9e-974a-369e6d04a335 admin admin] PATH_INFO: `/v3/roles` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:44:48.695365 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686a7524-9d80-4e9e-974a-369e6d04a335 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:44:48.697213 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686a7524-9d80-4e9e-974a-369e6d04a335 admin admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:44:48.709145 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 593/1187] 10.222.0.23 () {58 vars in 1122 bytes} [Sat Oct 1 20:44:48 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 20:44:48.713364 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebf09ad-5082-4aa3-8086-0d3d8ff808cc admin admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:44:48.729025 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebf09ad-5082-4aa3-8086-0d3d8ff808cc admin admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:44:48.736059 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29d61fe-ac2d-4c05-8ebe-fc3c48040b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f2619d8f534f3eace3cce529462560', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:44:48.738401 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29d61fe-ac2d-4c05-8ebe-fc3c48040b34 admin admin] REQUEST_METHOD: `PUT` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:44:48.738401 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29d61fe-ac2d-4c05-8ebe-fc3c48040b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:44:48.738401 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29d61fe-ac2d-4c05-8ebe-fc3c48040b34 admin admin] PATH_INFO: `/v3/projects/833ffd477dc641c0a663abe70a004618/users/f5674077fb5848cbb680cd10c0e23694/roles/d11e7ba2f1fa41ff8ea8dda2a8d1466f` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:44:48.757145 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29d61fe-ac2d-4c05-8ebe-fc3c48040b34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=833ffd477dc641c0a663abe70a004618, user_id=f5674077fb5848cbb680cd10c0e23694, role_id=d11e7ba2f1fa41ff8ea8dda2a8d1466f)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:44:48.761496 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29d61fe-ac2d-4c05-8ebe-fc3c48040b34 admin admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:44:48.780290 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 595/1188] 10.222.0.23 () {60 vars in 1483 bytes} [Sat Oct 1 20:44:48 2022] PUT /identity/v3/projects/833ffd477dc641c0a663abe70a004618/users/f5674077fb5848cbb680cd10c0e23694/roles/d11e7ba2f1fa41ff8ea8dda2a8d1466f => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 20:44:48.784078 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686a7524-9d80-4e9e-974a-369e6d04a335 admin admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:44:48.795715 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686a7524-9d80-4e9e-974a-369e6d04a335 admin admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:44:48.893949 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620b8d3c-4ea5-4f8e-9b45-e176bf26b70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f2619d8f534f3eace3cce529462560', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:44:48.895418 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b8d3c-4ea5-4f8e-9b45-e176bf26b70b admin admin] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:44:48.897539 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b8d3c-4ea5-4f8e-9b45-e176bf26b70b admin admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:44:48.898068 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b8d3c-4ea5-4f8e-9b45-e176bf26b70b admin admin] PATH_INFO: `/v3/roles` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:44:48.900218 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620b8d3c-4ea5-4f8e-9b45-e176bf26b70b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:44:48.904049 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620b8d3c-4ea5-4f8e-9b45-e176bf26b70b admin admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:44:48.922325 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 594/1189] 10.222.0.23 () {58 vars in 1122 bytes} [Sat Oct 1 20:44:48 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 20:44:48.926397 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29d61fe-ac2d-4c05-8ebe-fc3c48040b34 admin admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:44:48.941764 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29d61fe-ac2d-4c05-8ebe-fc3c48040b34 admin admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:44:48.955939 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2595f132-b8fa-4d34-8458-6b5d8537635a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f2619d8f534f3eace3cce529462560', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:44:48.956776 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595f132-b8fa-4d34-8458-6b5d8537635a admin admin] REQUEST_METHOD: `PUT` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:44:48.956938 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595f132-b8fa-4d34-8458-6b5d8537635a admin admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:44:48.957203 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595f132-b8fa-4d34-8458-6b5d8537635a admin admin] PATH_INFO: `/v3/projects/833ffd477dc641c0a663abe70a004618/users/f5674077fb5848cbb680cd10c0e23694/roles/d11e7ba2f1fa41ff8ea8dda2a8d1466f` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:44:48.968254 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2595f132-b8fa-4d34-8458-6b5d8537635a admin admin] RBAC: Authorizing `identity:create_grant(project_id=833ffd477dc641c0a663abe70a004618, user_id=f5674077fb5848cbb680cd10c0e23694, role_id=d11e7ba2f1fa41ff8ea8dda2a8d1466f)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:44:48.975930 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2595f132-b8fa-4d34-8458-6b5d8537635a admin admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:44:48.991942 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 596/1190] 10.222.0.23 () {60 vars in 1483 bytes} [Sat Oct 1 20:44:48 2022] PUT /identity/v3/projects/833ffd477dc641c0a663abe70a004618/users/f5674077fb5848cbb680cd10c0e23694/roles/d11e7ba2f1fa41ff8ea8dda2a8d1466f => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 20:44:54.588140 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79604049-dd47-4170-bf7d-da86cdd1957f None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:44:54.589037 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79604049-dd47-4170-bf7d-da86cdd1957f None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:44:54.589472 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79604049-dd47-4170-bf7d-da86cdd1957f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:44:54.657172 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-79604049-dd47-4170-bf7d-da86cdd1957f None None] MFA Rules not processed for user `fd0e2d3f911147ac9b374eaf22ea1dff`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:44:54.658495 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-79604049-dd47-4170-bf7d-da86cdd1957f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:44:54.751598 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:44:54.784415 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 595/1191] 10.222.0.23 () {58 vars in 958 bytes} [Sat Oct 1 20:44:54 2022] POST /identity/v3/auth/tokens => generated 2889 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:44:54.799211 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2595f132-b8fa-4d34-8458-6b5d8537635a admin admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:44:54.801052 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-2595f132-b8fa-4d34-8458-6b5d8537635a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:44:54.859182 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:44:54.917279 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2595f132-b8fa-4d34-8458-6b5d8537635a admin admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:44:54.924441 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef88d4b-1bde-4661-a231-7c62ff4b64ff service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4029dd2379eb4f5aab7c129a94d29b0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f242c4eeaa04ed19dcdc8ba95b86cfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:44:54.925485 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef88d4b-1bde-4661-a231-7c62ff4b64ff service glance] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:44:54.925698 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef88d4b-1bde-4661-a231-7c62ff4b64ff service glance] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:44:54.926036 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef88d4b-1bde-4661-a231-7c62ff4b64ff service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:44:55.056453 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef88d4b-1bde-4661-a231-7c62ff4b64ff service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:44:55.058417 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef88d4b-1bde-4661-a231-7c62ff4b64ff service glance] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:44:55.077569 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 597/1192] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Oct 1 20:44:54 2022] GET /identity/v3/auth/tokens => generated 2822 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 20:44:55.833400 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8885421-7de5-4d68-b24d-2d963149da37 None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:44:55.833936 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8885421-7de5-4d68-b24d-2d963149da37 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:44:55.834035 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8885421-7de5-4d68-b24d-2d963149da37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:44:55.877901 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-e8885421-7de5-4d68-b24d-2d963149da37 None None] MFA Rules not processed for user `f5674077fb5848cbb680cd10c0e23694`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:44:55.879200 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-e8885421-7de5-4d68-b24d-2d963149da37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:44:55.975076 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 596/1193] 10.222.0.23 () {58 vars in 958 bytes} [Sat Oct 1 20:44:55 2022] POST /identity/v3/auth/tokens => generated 2883 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:44:55.996953 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef88d4b-1bde-4661-a231-7c62ff4b64ff service glance] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:44:56.009745 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef88d4b-1bde-4661-a231-7c62ff4b64ff service glance] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:44:56.017146 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b349c6-59b4-4211-8237-5e71ad85dab4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4029dd2379eb4f5aab7c129a94d29b0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f242c4eeaa04ed19dcdc8ba95b86cfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:44:56.018042 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b349c6-59b4-4211-8237-5e71ad85dab4 service glance] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:44:56.018497 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b349c6-59b4-4211-8237-5e71ad85dab4 service glance] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:44:56.018965 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b349c6-59b4-4211-8237-5e71ad85dab4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:44:56.103597 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b349c6-59b4-4211-8237-5e71ad85dab4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:44:56.105319 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b349c6-59b4-4211-8237-5e71ad85dab4 service glance] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:44:56.119000 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 598/1194] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Oct 1 20:44:55 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 01 20:45:03.347693 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7344265-d69d-46b0-9195-e9ed829aa059 None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:45:03.348182 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7344265-d69d-46b0-9195-e9ed829aa059 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:45:03.348458 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7344265-d69d-46b0-9195-e9ed829aa059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:45:03.369108 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-c7344265-d69d-46b0-9195-e9ed829aa059 None None] MFA Rules not processed for user `bbfba81504d14188aa392affce459462`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:45:03.369825 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-c7344265-d69d-46b0-9195-e9ed829aa059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:45:03.381723 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 597/1195] 10.222.0.23 () {58 vars in 958 bytes} [Sat Oct 1 20:45:03 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:45:03.694032 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92369ab-49d4-46da-a0ad-c6330527738a None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:45:03.694516 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92369ab-49d4-46da-a0ad-c6330527738a None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:45:03.694600 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92369ab-49d4-46da-a0ad-c6330527738a None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:45:03.697198 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 599/1196] 10.222.0.23 () {54 vars in 961 bytes} [Sat Oct 1 20:45:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:45:03.701897 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c037bbb-4b42-43b0-9ec0-91f8cff30f21 None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:45:03.702795 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c037bbb-4b42-43b0-9ec0-91f8cff30f21 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:45:03.703412 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c037bbb-4b42-43b0-9ec0-91f8cff30f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:45:03.749823 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-2c037bbb-4b42-43b0-9ec0-91f8cff30f21 None None] MFA Rules not processed for user `b9c31d26f19d46f09e2f2e5e660234f2`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:45:03.751297 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-2c037bbb-4b42-43b0-9ec0-91f8cff30f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:45:03.841468 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 598/1197] 10.222.0.23 () {58 vars in 1058 bytes} [Sat Oct 1 20:45:03 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:45:03.848945 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b3a64-ac6a-4f52-b9c5-92c9f657207f None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:45:03.849435 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b3a64-ac6a-4f52-b9c5-92c9f657207f None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:45:03.849802 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b3a64-ac6a-4f52-b9c5-92c9f657207f None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:45:03.851614 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 600/1198] 10.222.0.23 () {54 vars in 912 bytes} [Sat Oct 1 20:45:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:45:03.859169 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e5aa9-243d-47b3-914c-2da95c6ad602 None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:45:03.859447 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e5aa9-243d-47b3-914c-2da95c6ad602 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:45:03.859910 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e5aa9-243d-47b3-914c-2da95c6ad602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:45:03.895687 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-6b2e5aa9-243d-47b3-914c-2da95c6ad602 None None] MFA Rules not processed for user `b9c31d26f19d46f09e2f2e5e660234f2`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:45:03.898390 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-6b2e5aa9-243d-47b3-914c-2da95c6ad602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:45:03.914906 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 599/1199] 10.222.0.23 () {58 vars in 1009 bytes} [Sat Oct 1 20:45:03 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:45:03.929404 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51b3a64-ac6a-4f52-b9c5-92c9f657207f None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:45:03.931471 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-f51b3a64-ac6a-4f52-b9c5-92c9f657207f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:45:03.951588 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51b3a64-ac6a-4f52-b9c5-92c9f657207f None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:45:03.956972 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67d746d-77bf-4003-bac6-192307b45c84 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4029dd2379eb4f5aab7c129a94d29b0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f242c4eeaa04ed19dcdc8ba95b86cfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:45:03.957606 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d746d-77bf-4003-bac6-192307b45c84 service glance] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:45:03.957869 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d746d-77bf-4003-bac6-192307b45c84 service glance] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:45:03.958174 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d746d-77bf-4003-bac6-192307b45c84 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:45:03.971724 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67d746d-77bf-4003-bac6-192307b45c84 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:45:03.973364 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67d746d-77bf-4003-bac6-192307b45c84 service glance] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:45:03.999987 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 601/1200] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Oct 1 20:45:03 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 20:45:04.550821 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70ef69b-7cfb-4bf3-8b93-93de3d1b9365 None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:45:04.551392 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70ef69b-7cfb-4bf3-8b93-93de3d1b9365 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:45:04.551392 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70ef69b-7cfb-4bf3-8b93-93de3d1b9365 None None] PATH_INFO: `/` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:45:04.552808 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 600/1201] 10.222.0.23 () {54 vars in 912 bytes} [Sat Oct 1 20:45:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:45:04.560254 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6066cac1-77b8-44da-b8a1-0555f8806dd9 None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:45:04.562349 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6066cac1-77b8-44da-b8a1-0555f8806dd9 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:45:04.562518 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6066cac1-77b8-44da-b8a1-0555f8806dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:45:04.623825 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-6066cac1-77b8-44da-b8a1-0555f8806dd9 None None] MFA Rules not processed for user `d498314742474614b90a1350359f506a`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:45:04.626448 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-6066cac1-77b8-44da-b8a1-0555f8806dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:45:04.684238 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:45:04.698375 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 602/1202] 10.222.0.23 () {58 vars in 1009 bytes} [Sat Oct 1 20:45:04 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:45:04.713614 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70ef69b-7cfb-4bf3-8b93-93de3d1b9365 None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:45:04.732974 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70ef69b-7cfb-4bf3-8b93-93de3d1b9365 None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:45:04.740406 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033e603a-66fc-4b4e-b794-4863cd9ae521 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd498314742474614b90a1350359f506a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f242c4eeaa04ed19dcdc8ba95b86cfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:45:04.741578 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e603a-66fc-4b4e-b794-4863cd9ae521 service neutron] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:45:04.742232 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e603a-66fc-4b4e-b794-4863cd9ae521 service neutron] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:45:04.742585 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e603a-66fc-4b4e-b794-4863cd9ae521 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:45:04.754572 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033e603a-66fc-4b4e-b794-4863cd9ae521 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:45:04.756267 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033e603a-66fc-4b4e-b794-4863cd9ae521 service neutron] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:45:04.772717 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 601/1203] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Oct 1 20:45:04 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 20:45:05.311376 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8815cae0-96b2-43e4-9dfa-bd05ce240d4a None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:45:05.311661 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8815cae0-96b2-43e4-9dfa-bd05ce240d4a None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:45:05.311934 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8815cae0-96b2-43e4-9dfa-bd05ce240d4a None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:45:05.313645 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 603/1204] 10.222.0.23 () {54 vars in 961 bytes} [Sat Oct 1 20:45:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:45:05.336275 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0c2486-dfb8-4adc-bb20-145a44a8a61c None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:45:05.336659 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0c2486-dfb8-4adc-bb20-145a44a8a61c None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:45:05.337029 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0c2486-dfb8-4adc-bb20-145a44a8a61c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:45:05.341807 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8815cae0-96b2-43e4-9dfa-bd05ce240d4a None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:45:05.365625 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-cf0c2486-dfb8-4adc-bb20-145a44a8a61c None None] MFA Rules not processed for user `b9c31d26f19d46f09e2f2e5e660234f2`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:45:05.366955 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-cf0c2486-dfb8-4adc-bb20-145a44a8a61c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:45:05.376875 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 602/1205] 10.222.0.23 () {58 vars in 1058 bytes} [Sat Oct 1 20:45:05 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 01 20:45:05.388679 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842b900f-1b4d-45c0-b96b-0b0280a07712 None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:45:05.389101 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842b900f-1b4d-45c0-b96b-0b0280a07712 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:45:05.389475 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842b900f-1b4d-45c0-b96b-0b0280a07712 None None] PATH_INFO: `/` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:45:05.392858 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 603/1206] 10.222.0.23 () {54 vars in 912 bytes} [Sat Oct 1 20:45:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:45:05.401818 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2bf7e5-960e-40f7-a612-689fa48c2a96 None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:45:05.402744 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2bf7e5-960e-40f7-a612-689fa48c2a96 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:45:05.403077 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2bf7e5-960e-40f7-a612-689fa48c2a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:45:05.439674 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-df2bf7e5-960e-40f7-a612-689fa48c2a96 None None] MFA Rules not processed for user `b9c31d26f19d46f09e2f2e5e660234f2`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:45:05.441410 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-df2bf7e5-960e-40f7-a612-689fa48c2a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:45:05.453584 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8815cae0-96b2-43e4-9dfa-bd05ce240d4a None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:45:05.458619 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 604/1207] 10.222.0.23 () {58 vars in 1009 bytes} [Sat Oct 1 20:45:05 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:45:05.461977 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3839f7a3-4303-426d-9a47-b32dfb52440f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '645c8f9d14a743c2b1103eec2a07c4e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f242c4eeaa04ed19dcdc8ba95b86cfb', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:45:05.463431 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3839f7a3-4303-426d-9a47-b32dfb52440f service placement] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:45:05.463714 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3839f7a3-4303-426d-9a47-b32dfb52440f service placement] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:45:05.465406 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3839f7a3-4303-426d-9a47-b32dfb52440f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:45:05.465955 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2bf7e5-960e-40f7-a612-689fa48c2a96 None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:45:05.470254 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-3839f7a3-4303-426d-9a47-b32dfb52440f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:45:05.483138 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2bf7e5-960e-40f7-a612-689fa48c2a96 None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:45:05.489227 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b646707-ad0b-49f6-9684-ea400b8b8164 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd498314742474614b90a1350359f506a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f242c4eeaa04ed19dcdc8ba95b86cfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:45:05.491772 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b646707-ad0b-49f6-9684-ea400b8b8164 service neutron] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:45:05.493189 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b646707-ad0b-49f6-9684-ea400b8b8164 service neutron] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:45:05.494451 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b646707-ad0b-49f6-9684-ea400b8b8164 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:45:05.495018 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3839f7a3-4303-426d-9a47-b32dfb52440f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:45:05.498840 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3839f7a3-4303-426d-9a47-b32dfb52440f service placement] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:45:05.514569 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b646707-ad0b-49f6-9684-ea400b8b8164 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:45:05.517160 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b646707-ad0b-49f6-9684-ea400b8b8164 service neutron] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:45:05.532018 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 604/1208] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Oct 1 20:45:05 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 01 20:45:05.534534 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 605/1209] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Oct 1 20:45:05 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 01 20:45:15.512935 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=34 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:45:15.528071 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=97 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:45:17.156150 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f72b89-6a4a-4784-a049-06f67bdbb2c7 None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:45:17.156871 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f72b89-6a4a-4784-a049-06f67bdbb2c7 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:45:17.156871 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f72b89-6a4a-4784-a049-06f67bdbb2c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:45:17.177021 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-a3f72b89-6a4a-4784-a049-06f67bdbb2c7 None None] MFA Rules not processed for user `d498314742474614b90a1350359f506a`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:45:17.178511 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-a3f72b89-6a4a-4784-a049-06f67bdbb2c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:45:17.185071 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 605/1210] 10.222.0.20 () {58 vars in 1015 bytes} [Sat Oct 1 20:45:17 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:45:17.196645 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b646707-ad0b-49f6-9684-ea400b8b8164 service neutron] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:45:17.205696 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b646707-ad0b-49f6-9684-ea400b8b8164 service neutron] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:45:17.209467 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea37948-958c-411f-bc58-51a2aa946e65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd498314742474614b90a1350359f506a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f242c4eeaa04ed19dcdc8ba95b86cfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:45:17.210154 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea37948-958c-411f-bc58-51a2aa946e65 service neutron] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:45:17.210436 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea37948-958c-411f-bc58-51a2aa946e65 service neutron] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:45:17.210704 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea37948-958c-411f-bc58-51a2aa946e65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:45:17.218781 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea37948-958c-411f-bc58-51a2aa946e65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:45:17.220431 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea37948-958c-411f-bc58-51a2aa946e65 service neutron] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:45:17.228123 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 606/1211] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Oct 1 20:45:17 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 20:45:18.221285 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553008ab-10f2-481a-97d3-8c02c3cd19c7 None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:45:18.221902 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553008ab-10f2-481a-97d3-8c02c3cd19c7 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:45:18.221902 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553008ab-10f2-481a-97d3-8c02c3cd19c7 None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:45:18.223357 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 606/1212] 10.222.0.23 () {54 vars in 921 bytes} [Sat Oct 1 20:45:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:45:18.253205 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433a050-8ce6-4c66-acae-59847d5fd33d None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:45:18.253811 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433a050-8ce6-4c66-acae-59847d5fd33d None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:45:18.253811 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433a050-8ce6-4c66-acae-59847d5fd33d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:45:18.275706 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-3433a050-8ce6-4c66-acae-59847d5fd33d None None] MFA Rules not processed for user `b9c31d26f19d46f09e2f2e5e660234f2`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:45:18.277901 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-3433a050-8ce6-4c66-acae-59847d5fd33d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:45:18.287341 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 607/1213] 10.222.0.23 () {58 vars in 1018 bytes} [Sat Oct 1 20:45:18 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 01 20:45:18.305618 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553008ab-10f2-481a-97d3-8c02c3cd19c7 None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:45:18.320624 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553008ab-10f2-481a-97d3-8c02c3cd19c7 None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:45:18.333229 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abfbb0b-c719-4183-a4af-3a0c6b3532f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9c31d26f19d46f09e2f2e5e660234f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f242c4eeaa04ed19dcdc8ba95b86cfb', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:45:18.333843 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abfbb0b-c719-4183-a4af-3a0c6b3532f6 service nova] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:45:18.334116 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abfbb0b-c719-4183-a4af-3a0c6b3532f6 service nova] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:45:18.335039 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abfbb0b-c719-4183-a4af-3a0c6b3532f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:45:18.344990 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abfbb0b-c719-4183-a4af-3a0c6b3532f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:45:18.346754 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abfbb0b-c719-4183-a4af-3a0c6b3532f6 service nova] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:45:18.357779 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 607/1214] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Oct 1 20:45:18 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 01 20:45:26.365920 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918ddee0-8877-402f-b0f4-3b7dd70c998a None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:45:26.366605 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918ddee0-8877-402f-b0f4-3b7dd70c998a None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:45:26.366605 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918ddee0-8877-402f-b0f4-3b7dd70c998a None None] PATH_INFO: `/` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:45:26.367790 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 608/1215] 10.222.0.23 () {54 vars in 921 bytes} [Sat Oct 1 20:45:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:45:26.383863 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b1ce59-bad2-431c-b62e-97875332acdf None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:45:26.384424 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b1ce59-bad2-431c-b62e-97875332acdf None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:45:26.384424 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b1ce59-bad2-431c-b62e-97875332acdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:45:26.406995 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-d0b1ce59-bad2-431c-b62e-97875332acdf None None] MFA Rules not processed for user `b9c31d26f19d46f09e2f2e5e660234f2`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:45:26.408202 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-d0b1ce59-bad2-431c-b62e-97875332acdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:45:26.417422 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 608/1216] 10.222.0.23 () {58 vars in 1018 bytes} [Sat Oct 1 20:45:26 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:45:26.429712 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918ddee0-8877-402f-b0f4-3b7dd70c998a None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:45:26.444805 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918ddee0-8877-402f-b0f4-3b7dd70c998a None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:45:26.452011 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d329a56-b5d0-4d04-b6fd-279072cd382e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9c31d26f19d46f09e2f2e5e660234f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f242c4eeaa04ed19dcdc8ba95b86cfb', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:45:26.452699 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d329a56-b5d0-4d04-b6fd-279072cd382e service nova] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:45:26.452984 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d329a56-b5d0-4d04-b6fd-279072cd382e service nova] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:45:26.453262 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d329a56-b5d0-4d04-b6fd-279072cd382e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:45:26.472866 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d329a56-b5d0-4d04-b6fd-279072cd382e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:45:26.474549 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d329a56-b5d0-4d04-b6fd-279072cd382e service nova] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:45:26.485773 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 609/1217] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Oct 1 20:45:26 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 20:45:36.401352 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=12 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:45:36.482459 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=15 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:45:40.487136 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b1ce59-bad2-431c-b62e-97875332acdf None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:45:40.496294 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b1ce59-bad2-431c-b62e-97875332acdf None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:45:40.500667 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6ca57f-6e4b-4e95-b0ba-2b21608070d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd498314742474614b90a1350359f506a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f242c4eeaa04ed19dcdc8ba95b86cfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:45:40.501264 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6ca57f-6e4b-4e95-b0ba-2b21608070d7 service neutron] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:45:40.501537 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6ca57f-6e4b-4e95-b0ba-2b21608070d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:45:40.501802 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6ca57f-6e4b-4e95-b0ba-2b21608070d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:45:40.511352 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6ca57f-6e4b-4e95-b0ba-2b21608070d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:45:40.512930 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6ca57f-6e4b-4e95-b0ba-2b21608070d7 service neutron] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:45:40.523030 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 609/1218] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Oct 1 20:45:40 2022] GET /identity/v3/auth/tokens => generated 2889 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 20:45:50.518718 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=6 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:45:53.678664 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e61a74-9d07-4614-8acc-0e33d2a1d01c None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:45:53.679189 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e61a74-9d07-4614-8acc-0e33d2a1d01c None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:45:53.679189 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e61a74-9d07-4614-8acc-0e33d2a1d01c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:45:53.697922 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-e4e61a74-9d07-4614-8acc-0e33d2a1d01c None None] MFA Rules not processed for user `f1645806dcdd41ea9c174bd4a9551899`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:45:53.699760 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-e4e61a74-9d07-4614-8acc-0e33d2a1d01c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:45:53.706692 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 610/1219] 10.222.0.23 () {58 vars in 958 bytes} [Sat Oct 1 20:45:53 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:46:03.693129 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=3 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:46:20.348605 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc79526-946b-4f58-8995-8bd0bc23081e None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:46:20.349096 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc79526-946b-4f58-8995-8bd0bc23081e None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:46:20.349182 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc79526-946b-4f58-8995-8bd0bc23081e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:46:20.368414 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-8bc79526-946b-4f58-8995-8bd0bc23081e None None] MFA Rules not processed for user `f1645806dcdd41ea9c174bd4a9551899`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:46:20.369702 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-8bc79526-946b-4f58-8995-8bd0bc23081e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:46:20.377410 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 610/1220] 10.222.0.23 () {58 vars in 958 bytes} [Sat Oct 1 20:46:20 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:46:30.363596 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=3 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:46:34.844473 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e229861-62fa-4b5e-a12a-ad145b314ac9 None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:46:34.844994 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e229861-62fa-4b5e-a12a-ad145b314ac9 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:46:34.845094 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e229861-62fa-4b5e-a12a-ad145b314ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:46:34.864328 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-1e229861-62fa-4b5e-a12a-ad145b314ac9 None None] MFA Rules not processed for user `f1645806dcdd41ea9c174bd4a9551899`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:46:34.865588 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-1e229861-62fa-4b5e-a12a-ad145b314ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:46:34.873084 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 611/1221] 10.222.0.23 () {58 vars in 958 bytes} [Sat Oct 1 20:46:34 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:46:44.858823 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=3 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:47:34.830305 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b45ffd-27c8-4ffe-b296-bf0ad50a1a37 None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:47:34.830831 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b45ffd-27c8-4ffe-b296-bf0ad50a1a37 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:47:34.830831 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b45ffd-27c8-4ffe-b296-bf0ad50a1a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:47:34.851910 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-c0b45ffd-27c8-4ffe-b296-bf0ad50a1a37 None None] MFA Rules not processed for user `f1645806dcdd41ea9c174bd4a9551899`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:47:34.853146 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-c0b45ffd-27c8-4ffe-b296-bf0ad50a1a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:47:34.860406 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 611/1222] 10.222.0.23 () {58 vars in 958 bytes} [Sat Oct 1 20:47:34 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:47:44.846494 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=3 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:47:47.644266 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e229861-62fa-4b5e-a12a-ad145b314ac9 None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:47:47.663586 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e229861-62fa-4b5e-a12a-ad145b314ac9 None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:47:47.667699 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c9df85-2b69-4b08-8aba-3d8170f66b9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd498314742474614b90a1350359f506a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f242c4eeaa04ed19dcdc8ba95b86cfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:47:47.668290 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c9df85-2b69-4b08-8aba-3d8170f66b9f service neutron] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:47:47.668589 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c9df85-2b69-4b08-8aba-3d8170f66b9f service neutron] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:47:47.668858 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c9df85-2b69-4b08-8aba-3d8170f66b9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:47:47.677846 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c9df85-2b69-4b08-8aba-3d8170f66b9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:47:47.679277 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c9df85-2b69-4b08-8aba-3d8170f66b9f service neutron] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:47:47.688656 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 612/1223] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Oct 1 20:47:47 2022] GET /identity/v3/auth/tokens => generated 2883 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 20:47:57.684585 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=10 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:49:05.292944 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b45ffd-27c8-4ffe-b296-bf0ad50a1a37 None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:49:05.322455 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b45ffd-27c8-4ffe-b296-bf0ad50a1a37 None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:49:05.327493 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97cbc35-2eca-48d3-8102-4f9222675fd1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '645c8f9d14a743c2b1103eec2a07c4e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f242c4eeaa04ed19dcdc8ba95b86cfb', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:49:05.328084 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97cbc35-2eca-48d3-8102-4f9222675fd1 service placement] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:49:05.328357 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97cbc35-2eca-48d3-8102-4f9222675fd1 service placement] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:49:05.328655 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97cbc35-2eca-48d3-8102-4f9222675fd1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:49:05.337967 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97cbc35-2eca-48d3-8102-4f9222675fd1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:49:05.339564 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97cbc35-2eca-48d3-8102-4f9222675fd1 service placement] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:49:05.349810 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 612/1224] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Oct 1 20:49:05 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 20:49:15.345233 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=10 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:49:55.656850 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c9df85-2b69-4b08-8aba-3d8170f66b9f service neutron] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:49:55.677466 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c9df85-2b69-4b08-8aba-3d8170f66b9f service neutron] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:49:55.682388 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af86622-c895-43b7-8b2b-ff4a48d5fb43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9c31d26f19d46f09e2f2e5e660234f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f242c4eeaa04ed19dcdc8ba95b86cfb', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:49:55.682976 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af86622-c895-43b7-8b2b-ff4a48d5fb43 service nova] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:49:55.683259 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af86622-c895-43b7-8b2b-ff4a48d5fb43 service nova] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:49:55.683530 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af86622-c895-43b7-8b2b-ff4a48d5fb43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:49:55.691095 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af86622-c895-43b7-8b2b-ff4a48d5fb43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:49:55.693571 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af86622-c895-43b7-8b2b-ff4a48d5fb43 service nova] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:49:55.702283 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 613/1225] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Oct 1 20:49:55 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 20:49:58.190010 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89431587-033c-4cff-bd47-2d86d7b9c2d0 None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:49:58.190556 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89431587-033c-4cff-bd47-2d86d7b9c2d0 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:49:58.190649 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89431587-033c-4cff-bd47-2d86d7b9c2d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:49:58.211362 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-89431587-033c-4cff-bd47-2d86d7b9c2d0 None None] MFA Rules not processed for user `f1645806dcdd41ea9c174bd4a9551899`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:49:58.212629 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-89431587-033c-4cff-bd47-2d86d7b9c2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:49:58.219591 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 613/1226] 10.222.0.23 () {58 vars in 958 bytes} [Sat Oct 1 20:49:58 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:50:03.664048 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af86622-c895-43b7-8b2b-ff4a48d5fb43 service nova] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:50:03.673289 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af86622-c895-43b7-8b2b-ff4a48d5fb43 service nova] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:50:03.677588 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e806afac-3536-47f8-8cfd-77e940ef901a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd498314742474614b90a1350359f506a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f242c4eeaa04ed19dcdc8ba95b86cfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:50:03.678175 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806afac-3536-47f8-8cfd-77e940ef901a service neutron] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:50:03.678443 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806afac-3536-47f8-8cfd-77e940ef901a service neutron] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:50:03.678705 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806afac-3536-47f8-8cfd-77e940ef901a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:50:03.687738 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e806afac-3536-47f8-8cfd-77e940ef901a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:50:03.689168 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e806afac-3536-47f8-8cfd-77e940ef901a service neutron] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:50:03.699476 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 614/1227] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Oct 1 20:50:03 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 20:50:04.879071 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89431587-033c-4cff-bd47-2d86d7b9c2d0 None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:50:04.888659 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89431587-033c-4cff-bd47-2d86d7b9c2d0 None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:50:04.892099 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4989b0-f5a5-4fe6-ae32-5a1f82f818c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd498314742474614b90a1350359f506a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f242c4eeaa04ed19dcdc8ba95b86cfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:50:04.892712 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4989b0-f5a5-4fe6-ae32-5a1f82f818c6 service neutron] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:50:04.892989 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4989b0-f5a5-4fe6-ae32-5a1f82f818c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:50:04.893256 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4989b0-f5a5-4fe6-ae32-5a1f82f818c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:50:04.904388 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4989b0-f5a5-4fe6-ae32-5a1f82f818c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:50:04.905886 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4989b0-f5a5-4fe6-ae32-5a1f82f818c6 service neutron] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:50:04.917014 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 614/1228] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Oct 1 20:50:04 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 20:50:13.695222 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=16 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:50:14.912342 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=9 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:50:16.703629 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e806afac-3536-47f8-8cfd-77e940ef901a service neutron] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:50:16.714104 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e806afac-3536-47f8-8cfd-77e940ef901a service neutron] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:50:16.719004 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1763e1ef-b4c5-4ec2-b228-74ebf0452c94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9c31d26f19d46f09e2f2e5e660234f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f242c4eeaa04ed19dcdc8ba95b86cfb', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:50:16.719590 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1763e1ef-b4c5-4ec2-b228-74ebf0452c94 service nova] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:50:16.719861 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1763e1ef-b4c5-4ec2-b228-74ebf0452c94 service nova] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:50:16.720124 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1763e1ef-b4c5-4ec2-b228-74ebf0452c94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:50:16.728847 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1763e1ef-b4c5-4ec2-b228-74ebf0452c94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:50:16.730264 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1763e1ef-b4c5-4ec2-b228-74ebf0452c94 service nova] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:50:16.739898 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 615/1229] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Oct 1 20:50:16 2022] GET /identity/v3/auth/tokens => generated 2822 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 20:50:17.298187 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4989b0-f5a5-4fe6-ae32-5a1f82f818c6 service neutron] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:50:17.307594 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4989b0-f5a5-4fe6-ae32-5a1f82f818c6 service neutron] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:50:17.311845 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e937f7bc-b0de-4754-8376-ff5aaeb0c615 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd498314742474614b90a1350359f506a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f242c4eeaa04ed19dcdc8ba95b86cfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:50:17.312611 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e937f7bc-b0de-4754-8376-ff5aaeb0c615 service neutron] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:50:17.312743 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e937f7bc-b0de-4754-8376-ff5aaeb0c615 service neutron] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:50:17.312985 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e937f7bc-b0de-4754-8376-ff5aaeb0c615 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:50:17.322140 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e937f7bc-b0de-4754-8376-ff5aaeb0c615 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:50:17.323396 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e937f7bc-b0de-4754-8376-ff5aaeb0c615 service neutron] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:50:17.332107 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 615/1230] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Oct 1 20:50:17 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 20:50:19.261000 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1763e1ef-b4c5-4ec2-b228-74ebf0452c94 service nova] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:50:19.272472 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1763e1ef-b4c5-4ec2-b228-74ebf0452c94 service nova] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:50:19.277624 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52af418a-31a0-4ab5-8296-0111bc650260 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9c31d26f19d46f09e2f2e5e660234f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f242c4eeaa04ed19dcdc8ba95b86cfb', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:50:19.278228 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52af418a-31a0-4ab5-8296-0111bc650260 service nova] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:50:19.278504 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52af418a-31a0-4ab5-8296-0111bc650260 service nova] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:50:19.278776 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52af418a-31a0-4ab5-8296-0111bc650260 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:50:19.287505 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52af418a-31a0-4ab5-8296-0111bc650260 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:50:19.289133 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52af418a-31a0-4ab5-8296-0111bc650260 service nova] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:50:19.298998 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 616/1231] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Oct 1 20:50:19 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 20:50:27.328682 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=6 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:50:29.294821 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=12 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:50:32.323700 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee48ad-fc0c-43f3-8333-619d5c258049 None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:50:32.324261 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee48ad-fc0c-43f3-8333-619d5c258049 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:50:32.324261 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee48ad-fc0c-43f3-8333-619d5c258049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:50:32.343191 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-53ee48ad-fc0c-43f3-8333-619d5c258049 None None] MFA Rules not processed for user `bbfba81504d14188aa392affce459462`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:50:32.344379 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-53ee48ad-fc0c-43f3-8333-619d5c258049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:50:32.352162 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 616/1232] 10.222.0.23 () {58 vars in 958 bytes} [Sat Oct 1 20:50:32 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:50:32.627683 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2bad2a-8c9f-46d5-88c8-16984b744094 None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:50:32.628245 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2bad2a-8c9f-46d5-88c8-16984b744094 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:50:32.628245 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2bad2a-8c9f-46d5-88c8-16984b744094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:50:32.687434 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-0c2bad2a-8c9f-46d5-88c8-16984b744094 None None] MFA Rules not processed for user `d498314742474614b90a1350359f506a`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:50:32.688633 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-0c2bad2a-8c9f-46d5-88c8-16984b744094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:50:32.696126 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 617/1233] 10.222.0.23 () {58 vars in 1009 bytes} [Sat Oct 1 20:50:32 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:50:32.708195 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ee48ad-fc0c-43f3-8333-619d5c258049 None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:50:32.718689 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ee48ad-fc0c-43f3-8333-619d5c258049 None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:50:32.723691 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc7f5dd-abcb-42b5-9474-6e8f491595bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd498314742474614b90a1350359f506a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f242c4eeaa04ed19dcdc8ba95b86cfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:50:32.724296 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc7f5dd-abcb-42b5-9474-6e8f491595bf service neutron] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:50:32.724600 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc7f5dd-abcb-42b5-9474-6e8f491595bf service neutron] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:50:32.725138 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc7f5dd-abcb-42b5-9474-6e8f491595bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:50:32.732865 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc7f5dd-abcb-42b5-9474-6e8f491595bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:50:32.734325 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc7f5dd-abcb-42b5-9474-6e8f491595bf service neutron] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:50:32.743289 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 617/1234] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Oct 1 20:50:32 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 20:50:33.137873 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f994973-95c5-4a96-8ebb-eb5709ee425b None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:50:33.138161 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f994973-95c5-4a96-8ebb-eb5709ee425b None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:50:33.138464 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f994973-95c5-4a96-8ebb-eb5709ee425b None None] PATH_INFO: `/` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:50:33.139809 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 618/1235] 10.222.0.23 () {54 vars in 961 bytes} [Sat Oct 1 20:50:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:50:33.145827 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddef4b0-376a-4575-8f8e-59b39615a489 None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:50:33.146107 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddef4b0-376a-4575-8f8e-59b39615a489 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:50:33.146380 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddef4b0-376a-4575-8f8e-59b39615a489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:50:33.201621 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-dddef4b0-376a-4575-8f8e-59b39615a489 None None] MFA Rules not processed for user `645c8f9d14a743c2b1103eec2a07c4e8`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:50:33.202827 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-dddef4b0-376a-4575-8f8e-59b39615a489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:50:33.214558 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 618/1236] 10.222.0.23 () {58 vars in 1058 bytes} [Sat Oct 1 20:50:33 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:50:33.222807 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f994973-95c5-4a96-8ebb-eb5709ee425b None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:50:33.237477 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f994973-95c5-4a96-8ebb-eb5709ee425b None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:50:33.242711 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66329bb-25ad-4468-859b-3dce4a5547cb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '645c8f9d14a743c2b1103eec2a07c4e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f242c4eeaa04ed19dcdc8ba95b86cfb', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:50:33.243303 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66329bb-25ad-4468-859b-3dce4a5547cb service placement] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:50:33.243575 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66329bb-25ad-4468-859b-3dce4a5547cb service placement] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:50:33.243841 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66329bb-25ad-4468-859b-3dce4a5547cb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:50:33.253431 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66329bb-25ad-4468-859b-3dce4a5547cb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:50:33.255017 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66329bb-25ad-4468-859b-3dce4a5547cb service placement] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:50:33.264548 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 619/1237] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Oct 1 20:50:33 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 20:50:43.198901 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=23 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:50:43.260578 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=19 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:50:52.075721 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddef4b0-376a-4575-8f8e-59b39615a489 None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:50:52.091501 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddef4b0-376a-4575-8f8e-59b39615a489 None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:50:52.097811 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7fb4de-1d5c-45b5-8b8d-08061755146c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9c31d26f19d46f09e2f2e5e660234f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f242c4eeaa04ed19dcdc8ba95b86cfb', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:50:52.098413 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7fb4de-1d5c-45b5-8b8d-08061755146c service nova] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:50:52.098686 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7fb4de-1d5c-45b5-8b8d-08061755146c service nova] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:50:52.098953 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7fb4de-1d5c-45b5-8b8d-08061755146c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:50:52.107430 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7fb4de-1d5c-45b5-8b8d-08061755146c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:50:52.109041 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7fb4de-1d5c-45b5-8b8d-08061755146c service nova] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:50:52.120427 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 619/1238] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Oct 1 20:50:52 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 20:51:00.891139 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66329bb-25ad-4468-859b-3dce4a5547cb service placement] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:51:00.900140 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66329bb-25ad-4468-859b-3dce4a5547cb service placement] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:51:00.903658 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f528c8ad-745e-4ceb-9bc3-753bb747ce66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd498314742474614b90a1350359f506a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f242c4eeaa04ed19dcdc8ba95b86cfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:51:00.904250 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f528c8ad-745e-4ceb-9bc3-753bb747ce66 service neutron] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:51:00.904543 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f528c8ad-745e-4ceb-9bc3-753bb747ce66 service neutron] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:51:00.904827 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f528c8ad-745e-4ceb-9bc3-753bb747ce66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:51:00.914579 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f528c8ad-745e-4ceb-9bc3-753bb747ce66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:51:00.915993 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f528c8ad-745e-4ceb-9bc3-753bb747ce66 service neutron] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:51:00.927169 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 620/1239] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Oct 1 20:51:00 2022] GET /identity/v3/auth/tokens => generated 2889 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 20:51:02.115709 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=6 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:51:10.922311 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=6 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:51:52.516946 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5623813-8f01-4bbc-a583-2e660d9b2c73 None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:51:52.517507 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5623813-8f01-4bbc-a583-2e660d9b2c73 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:51:52.517507 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5623813-8f01-4bbc-a583-2e660d9b2c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:51:52.536708 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-c5623813-8f01-4bbc-a583-2e660d9b2c73 None None] MFA Rules not processed for user `f1645806dcdd41ea9c174bd4a9551899`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:51:52.537907 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-c5623813-8f01-4bbc-a583-2e660d9b2c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:51:52.545937 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 620/1240] 10.222.0.23 () {58 vars in 958 bytes} [Sat Oct 1 20:51:52 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:52:02.532189 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=3 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:52:07.644432 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e65308f-b9d3-4e74-8944-1f5b4186c40f None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:52:07.645043 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e65308f-b9d3-4e74-8944-1f5b4186c40f None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:52:07.645043 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e65308f-b9d3-4e74-8944-1f5b4186c40f None None] PATH_INFO: `/` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:52:07.646390 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 621/1241] 10.222.0.23 () {54 vars in 921 bytes} [Sat Oct 1 20:52:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:52:07.651260 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a201e-f89e-4337-a4a3-6aad110373b0 None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:52:07.651707 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a201e-f89e-4337-a4a3-6aad110373b0 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:52:07.651807 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a201e-f89e-4337-a4a3-6aad110373b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:52:07.692239 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-2d6a201e-f89e-4337-a4a3-6aad110373b0 None None] MFA Rules not processed for user `b9c31d26f19d46f09e2f2e5e660234f2`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:52:07.693513 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-2d6a201e-f89e-4337-a4a3-6aad110373b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:52:07.703185 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 621/1242] 10.222.0.23 () {58 vars in 1018 bytes} [Sat Oct 1 20:52:07 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:52:07.714621 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e65308f-b9d3-4e74-8944-1f5b4186c40f None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:52:07.729070 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e65308f-b9d3-4e74-8944-1f5b4186c40f None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:52:07.734153 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552442f2-d447-4134-b8d7-ff44f19da709 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9c31d26f19d46f09e2f2e5e660234f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f242c4eeaa04ed19dcdc8ba95b86cfb', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:52:07.734752 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552442f2-d447-4134-b8d7-ff44f19da709 service nova] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:52:07.735031 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552442f2-d447-4134-b8d7-ff44f19da709 service nova] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:52:07.735305 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552442f2-d447-4134-b8d7-ff44f19da709 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:52:07.743615 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552442f2-d447-4134-b8d7-ff44f19da709 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:52:07.745229 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552442f2-d447-4134-b8d7-ff44f19da709 service nova] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:52:07.755222 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 622/1243] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Oct 1 20:52:07 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 20:52:17.689477 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=9 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:52:17.750972 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=6 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:53:28.745890 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6a201e-f89e-4337-a4a3-6aad110373b0 None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:53:28.747473 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-2d6a201e-f89e-4337-a4a3-6aad110373b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:53:28.787628 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6a201e-f89e-4337-a4a3-6aad110373b0 None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:53:28.792041 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04286c0b-b7c7-4680-9a9d-5619eb8fc67c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd498314742474614b90a1350359f506a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f242c4eeaa04ed19dcdc8ba95b86cfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:53:28.792664 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04286c0b-b7c7-4680-9a9d-5619eb8fc67c service neutron] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:53:28.792942 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04286c0b-b7c7-4680-9a9d-5619eb8fc67c service neutron] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:53:28.793218 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04286c0b-b7c7-4680-9a9d-5619eb8fc67c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:53:28.882638 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04286c0b-b7c7-4680-9a9d-5619eb8fc67c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:53:28.884757 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04286c0b-b7c7-4680-9a9d-5619eb8fc67c service neutron] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:53:28.903113 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 622/1244] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Oct 1 20:53:28 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 20:53:32.196097 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef320c7-941d-4e4e-a60c-5a475edfc3cc None None] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:53:32.201167 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef320c7-941d-4e4e-a60c-5a475edfc3cc None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:53:32.201167 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef320c7-941d-4e4e-a60c-5a475edfc3cc None None] PATH_INFO: `/` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:53:32.201167 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 623/1245] 10.222.0.23 () {54 vars in 921 bytes} [Sat Oct 1 20:53:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:53:32.203345 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b1de9-a9a2-4182-b3e9-f36e93e5425c None None] REQUEST_METHOD: `POST` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:53:32.203766 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b1de9-a9a2-4182-b3e9-f36e93e5425c None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:53:32.203917 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b1de9-a9a2-4182-b3e9-f36e93e5425c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:53:32.234617 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.auth.core [None req-247b1de9-a9a2-4182-b3e9-f36e93e5425c None None] MFA Rules not processed for user `645c8f9d14a743c2b1103eec2a07c4e8`. Rule list: `[]` (Enabled: `True`). {{(pid=94755) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:53:32.235845 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-247b1de9-a9a2-4182-b3e9-f36e93e5425c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:53:32.244771 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 623/1246] 10.222.0.23 () {58 vars in 1018 bytes} [Sat Oct 1 20:53:32 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:53:32.258300 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef320c7-941d-4e4e-a60c-5a475edfc3cc None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:53:32.277169 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef320c7-941d-4e4e-a60c-5a475edfc3cc None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:53:32.282540 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384993ca-32ae-43d5-bd7f-5a82aceec44f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '645c8f9d14a743c2b1103eec2a07c4e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f242c4eeaa04ed19dcdc8ba95b86cfb', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:53:32.283158 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384993ca-32ae-43d5-bd7f-5a82aceec44f service placement] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:53:32.283434 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384993ca-32ae-43d5-bd7f-5a82aceec44f service placement] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:53:32.283699 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384993ca-32ae-43d5-bd7f-5a82aceec44f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:53:32.292958 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384993ca-32ae-43d5-bd7f-5a82aceec44f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:53:32.294529 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384993ca-32ae-43d5-bd7f-5a82aceec44f service placement] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:53:32.304451 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 624/1247] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Oct 1 20:53:32 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 20:53:35.585915 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b1e48-5558-4c2a-b2eb-7d48a96a0e31 None None] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:53:35.586421 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b1e48-5558-4c2a-b2eb-7d48a96a0e31 None None] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:53:35.586510 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b1e48-5558-4c2a-b2eb-7d48a96a0e31 None None] PATH_INFO: `/` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:53:35.587861 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 624/1248] 10.222.0.23 () {54 vars in 921 bytes} [Sat Oct 1 20:53:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 20:53:35.593148 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cec11e-be9c-4ff2-a4bb-904d3d0dc011 None None] REQUEST_METHOD: `POST` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:53:35.593597 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cec11e-be9c-4ff2-a4bb-904d3d0dc011 None None] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:53:35.593951 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cec11e-be9c-4ff2-a4bb-904d3d0dc011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:53:35.613801 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.auth.core [None req-a6cec11e-be9c-4ff2-a4bb-904d3d0dc011 None None] MFA Rules not processed for user `645c8f9d14a743c2b1103eec2a07c4e8`. Rule list: `[]` (Enabled: `True`). {{(pid=94756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 20:53:35.615067 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-a6cec11e-be9c-4ff2-a4bb-904d3d0dc011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:53:35.624010 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 625/1249] 10.222.0.23 () {58 vars in 1018 bytes} [Sat Oct 1 20:53:35 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 20:53:35.637996 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210b1e48-5558-4c2a-b2eb-7d48a96a0e31 None None] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:53:35.652280 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210b1e48-5558-4c2a-b2eb-7d48a96a0e31 None None] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:53:35.661799 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be2393a-dc1d-4243-8355-8458b4f5b0e2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '645c8f9d14a743c2b1103eec2a07c4e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f242c4eeaa04ed19dcdc8ba95b86cfb', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:53:35.661799 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2393a-dc1d-4243-8355-8458b4f5b0e2 service placement] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:53:35.661799 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2393a-dc1d-4243-8355-8458b4f5b0e2 service placement] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:53:35.662069 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2393a-dc1d-4243-8355-8458b4f5b0e2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:53:35.663335 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cec11e-be9c-4ff2-a4bb-904d3d0dc011 None None] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:53:35.673745 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be2393a-dc1d-4243-8355-8458b4f5b0e2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:53:35.675340 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cec11e-be9c-4ff2-a4bb-904d3d0dc011 None None] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:53:35.675439 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be2393a-dc1d-4243-8355-8458b4f5b0e2 service placement] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:53:35.680785 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6e03af-682b-4886-9e41-7e30d6b6440a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f2619d8f534f3eace3cce529462560', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:53:35.681488 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e03af-682b-4886-9e41-7e30d6b6440a admin admin] REQUEST_METHOD: `DELETE` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:53:35.681833 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e03af-682b-4886-9e41-7e30d6b6440a admin admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:53:35.682112 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e03af-682b-4886-9e41-7e30d6b6440a admin admin] PATH_INFO: `/v3/users/bbfba81504d14188aa392affce459462` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:53:35.683244 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6e03af-682b-4886-9e41-7e30d6b6440a admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbfba81504d14188aa392affce459462)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:53:35.685199 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6e03af-682b-4886-9e41-7e30d6b6440a admin admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:53:35.686077 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 625/1250] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Oct 1 20:53:35 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 20:53:35.732608 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.notifications [None req-2d6e03af-682b-4886-9e41-7e30d6b6440a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbfba81504d14188aa392affce459462'} {{(pid=94756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 20:53:35.733265 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.notifications [None req-2d6e03af-682b-4886-9e41-7e30d6b6440a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbfba81504d14188aa392affce459462'} {{(pid=94756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 20:53:35.740672 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.notifications [None req-2d6e03af-682b-4886-9e41-7e30d6b6440a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbfba81504d14188aa392affce459462'} {{(pid=94756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 20:53:35.748001 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.notifications [None req-2d6e03af-682b-4886-9e41-7e30d6b6440a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbfba81504d14188aa392affce459462'} {{(pid=94756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 20:53:35.748676 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.notifications [None req-2d6e03af-682b-4886-9e41-7e30d6b6440a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbfba81504d14188aa392affce459462'} {{(pid=94756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 20:53:35.765919 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 626/1251] 10.222.0.23 () {58 vars in 1224 bytes} [Sat Oct 1 20:53:35 2022] DELETE /identity/v3/users/bbfba81504d14188aa392affce459462 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 20:53:35.942999 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be2393a-dc1d-4243-8355-8458b4f5b0e2 service placement] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:53:35.955886 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be2393a-dc1d-4243-8355-8458b4f5b0e2 service placement] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:53:36.016472 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78f7745-c731-4e85-82ec-f8ea3eb7dcf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f2619d8f534f3eace3cce529462560', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:53:36.017125 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f7745-c731-4e85-82ec-f8ea3eb7dcf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:53:36.017391 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f7745-c731-4e85-82ec-f8ea3eb7dcf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:53:36.017817 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f7745-c731-4e85-82ec-f8ea3eb7dcf6 admin admin] PATH_INFO: `/v3/projects/374fe0ae6ee448c9879a8266e51a3606` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:53:36.018933 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78f7745-c731-4e85-82ec-f8ea3eb7dcf6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=374fe0ae6ee448c9879a8266e51a3606)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:53:36.020890 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78f7745-c731-4e85-82ec-f8ea3eb7dcf6 admin admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:53:36.022885 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=100 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:53:36.073266 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.notifications [None req-c78f7745-c731-4e85-82ec-f8ea3eb7dcf6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '374fe0ae6ee448c9879a8266e51a3606', 'request_id': 'req-c78f7745-c731-4e85-82ec-f8ea3eb7dcf6'} {{(pid=94755) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 20:53:36.081381 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.notifications [None req-c78f7745-c731-4e85-82ec-f8ea3eb7dcf6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '374fe0ae6ee448c9879a8266e51a3606', 'request_id': 'req-c78f7745-c731-4e85-82ec-f8ea3eb7dcf6'} {{(pid=94755) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 20:53:36.087288 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.notifications [None req-c78f7745-c731-4e85-82ec-f8ea3eb7dcf6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '374fe0ae6ee448c9879a8266e51a3606', 'request_id': 'req-c78f7745-c731-4e85-82ec-f8ea3eb7dcf6'} {{(pid=94755) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 20:53:36.112334 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.notifications [None req-c78f7745-c731-4e85-82ec-f8ea3eb7dcf6 admin admin] The token cache is being invalidate because project 374fe0ae6ee448c9879a8266e51a3606 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=94755) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 20:53:36.112650 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.notifications [None req-c78f7745-c731-4e85-82ec-f8ea3eb7dcf6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=94755) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 20:53:36.113273 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.notifications [None req-c78f7745-c731-4e85-82ec-f8ea3eb7dcf6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=94755) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 20:53:36.114731 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 626/1252] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Oct 1 20:53:35 2022] DELETE /identity/v3/projects/374fe0ae6ee448c9879a8266e51a3606 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 20:53:36.119757 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6e03af-682b-4886-9e41-7e30d6b6440a admin admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:53:36.121163 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-2d6e03af-682b-4886-9e41-7e30d6b6440a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:53:36.135481 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6e03af-682b-4886-9e41-7e30d6b6440a admin admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:53:36.191354 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c91ec5-77b1-405b-b163-2071d85960b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f2619d8f534f3eace3cce529462560', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:53:36.191977 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c91ec5-77b1-405b-b163-2071d85960b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:53:36.192261 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c91ec5-77b1-405b-b163-2071d85960b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:53:36.192569 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c91ec5-77b1-405b-b163-2071d85960b1 admin admin] PATH_INFO: `/v3/users/fd0e2d3f911147ac9b374eaf22ea1dff` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:53:36.193666 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c91ec5-77b1-405b-b163-2071d85960b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd0e2d3f911147ac9b374eaf22ea1dff)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:53:36.196301 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c91ec5-77b1-405b-b163-2071d85960b1 admin admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:53:36.240275 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.notifications [None req-b7c91ec5-77b1-405b-b163-2071d85960b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd0e2d3f911147ac9b374eaf22ea1dff'} {{(pid=94756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 20:53:36.240949 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.notifications [None req-b7c91ec5-77b1-405b-b163-2071d85960b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd0e2d3f911147ac9b374eaf22ea1dff'} {{(pid=94756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 20:53:36.248312 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.notifications [None req-b7c91ec5-77b1-405b-b163-2071d85960b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd0e2d3f911147ac9b374eaf22ea1dff'} {{(pid=94756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 20:53:36.249532 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:53:36.257125 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.notifications [None req-b7c91ec5-77b1-405b-b163-2071d85960b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd0e2d3f911147ac9b374eaf22ea1dff'} {{(pid=94756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 20:53:36.258037 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.notifications [None req-b7c91ec5-77b1-405b-b163-2071d85960b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd0e2d3f911147ac9b374eaf22ea1dff'} {{(pid=94756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 20:53:36.275226 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 627/1253] 10.222.0.23 () {58 vars in 1224 bytes} [Sat Oct 1 20:53:36 2022] DELETE /identity/v3/users/fd0e2d3f911147ac9b374eaf22ea1dff => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 20:53:36.451666 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78f7745-c731-4e85-82ec-f8ea3eb7dcf6 admin admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:53:36.453215 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-c78f7745-c731-4e85-82ec-f8ea3eb7dcf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:53:36.469275 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78f7745-c731-4e85-82ec-f8ea3eb7dcf6 admin admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:53:36.527802 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1712b1-1143-49f9-961d-319a4d6d4491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f2619d8f534f3eace3cce529462560', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:53:36.528423 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1712b1-1143-49f9-961d-319a4d6d4491 admin admin] REQUEST_METHOD: `DELETE` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:53:36.528747 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1712b1-1143-49f9-961d-319a4d6d4491 admin admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:53:36.529014 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1712b1-1143-49f9-961d-319a4d6d4491 admin admin] PATH_INFO: `/v3/projects/3a6fa10149514c23b6ccf2136ed045be` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:53:36.530097 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1712b1-1143-49f9-961d-319a4d6d4491 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a6fa10149514c23b6ccf2136ed045be)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:53:36.531981 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1712b1-1143-49f9-961d-319a4d6d4491 admin admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:53:36.577354 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.notifications [None req-3e1712b1-1143-49f9-961d-319a4d6d4491 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a6fa10149514c23b6ccf2136ed045be', 'request_id': 'req-3e1712b1-1143-49f9-961d-319a4d6d4491'} {{(pid=94755) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 20:53:36.584449 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.notifications [None req-3e1712b1-1143-49f9-961d-319a4d6d4491 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a6fa10149514c23b6ccf2136ed045be', 'request_id': 'req-3e1712b1-1143-49f9-961d-319a4d6d4491'} {{(pid=94755) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 20:53:36.590810 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.notifications [None req-3e1712b1-1143-49f9-961d-319a4d6d4491 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a6fa10149514c23b6ccf2136ed045be', 'request_id': 'req-3e1712b1-1143-49f9-961d-319a4d6d4491'} {{(pid=94755) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 20:53:36.601660 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.notifications [None req-3e1712b1-1143-49f9-961d-319a4d6d4491 admin admin] The token cache is being invalidate because project 3a6fa10149514c23b6ccf2136ed045be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=94755) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 20:53:36.602075 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.notifications [None req-3e1712b1-1143-49f9-961d-319a4d6d4491 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=94755) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 20:53:36.602699 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.notifications [None req-3e1712b1-1143-49f9-961d-319a4d6d4491 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=94755) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 20:53:36.604848 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 627/1254] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Oct 1 20:53:36 2022] DELETE /identity/v3/projects/3a6fa10149514c23b6ccf2136ed045be => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 20:53:46.271578 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=11,keystone:DELETE=2 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:53:46.598770 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=80,keystone:DELETE=14,keystone:INSERT=2 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:54:09.195200 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c91ec5-77b1-405b-b163-2071d85960b1 admin admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:54:09.196619 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-b7c91ec5-77b1-405b-b163-2071d85960b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:54:09.263903 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c91ec5-77b1-405b-b163-2071d85960b1 admin admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:54:09.321555 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef0fad3-1bf7-4542-9780-77146691a87f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '645c8f9d14a743c2b1103eec2a07c4e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f242c4eeaa04ed19dcdc8ba95b86cfb', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:54:09.322137 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef0fad3-1bf7-4542-9780-77146691a87f service placement] REQUEST_METHOD: `GET` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:54:09.322414 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef0fad3-1bf7-4542-9780-77146691a87f service placement] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:54:09.322683 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef0fad3-1bf7-4542-9780-77146691a87f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:54:09.324408 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-bef0fad3-1bf7-4542-9780-77146691a87f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:54:09.335259 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef0fad3-1bf7-4542-9780-77146691a87f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:54:09.336882 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef0fad3-1bf7-4542-9780-77146691a87f service placement] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:54:09.346213 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 628/1255] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Oct 1 20:54:09 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 20:54:19.342347 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=58 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:54:29.888197 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1712b1-1143-49f9-961d-319a4d6d4491 admin admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:54:29.889685 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-3e1712b1-1143-49f9-961d-319a4d6d4491 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:54:29.947056 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1712b1-1143-49f9-961d-319a4d6d4491 admin admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:54:29.950699 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b136bb8b-0f28-40cd-8e6b-cd092aef5c23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd498314742474614b90a1350359f506a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f242c4eeaa04ed19dcdc8ba95b86cfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:54:29.951337 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b136bb8b-0f28-40cd-8e6b-cd092aef5c23 service neutron] REQUEST_METHOD: `GET` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:54:29.951599 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b136bb8b-0f28-40cd-8e6b-cd092aef5c23 service neutron] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:54:29.951870 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b136bb8b-0f28-40cd-8e6b-cd092aef5c23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:54:29.953615 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-b136bb8b-0f28-40cd-8e6b-cd092aef5c23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:54:30.019111 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b136bb8b-0f28-40cd-8e6b-cd092aef5c23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:54:30.021123 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b136bb8b-0f28-40cd-8e6b-cd092aef5c23 service neutron] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:54:30.030692 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 628/1256] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Oct 1 20:54:29 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 01 20:54:36.312970 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef0fad3-1bf7-4542-9780-77146691a87f service placement] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:54:36.314430 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-bef0fad3-1bf7-4542-9780-77146691a87f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:54:36.327785 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef0fad3-1bf7-4542-9780-77146691a87f service placement] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:54:36.332411 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fbaac5-a02d-4bc8-b48a-5f988f9f2349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f2619d8f534f3eace3cce529462560', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:54:36.333076 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fbaac5-a02d-4bc8-b48a-5f988f9f2349 admin admin] REQUEST_METHOD: `DELETE` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:54:36.333367 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fbaac5-a02d-4bc8-b48a-5f988f9f2349 admin admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:54:36.333636 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fbaac5-a02d-4bc8-b48a-5f988f9f2349 admin admin] PATH_INFO: `/v3/users/f1645806dcdd41ea9c174bd4a9551899` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:54:36.334763 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fbaac5-a02d-4bc8-b48a-5f988f9f2349 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1645806dcdd41ea9c174bd4a9551899)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:54:36.336713 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fbaac5-a02d-4bc8-b48a-5f988f9f2349 admin admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:54:36.382171 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.notifications [None req-43fbaac5-a02d-4bc8-b48a-5f988f9f2349 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1645806dcdd41ea9c174bd4a9551899'} {{(pid=94756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 20:54:36.382831 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.notifications [None req-43fbaac5-a02d-4bc8-b48a-5f988f9f2349 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1645806dcdd41ea9c174bd4a9551899'} {{(pid=94756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 20:54:36.390024 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.notifications [None req-43fbaac5-a02d-4bc8-b48a-5f988f9f2349 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1645806dcdd41ea9c174bd4a9551899'} {{(pid=94756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 20:54:36.397115 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.notifications [None req-43fbaac5-a02d-4bc8-b48a-5f988f9f2349 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1645806dcdd41ea9c174bd4a9551899'} {{(pid=94756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 20:54:36.397749 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.notifications [None req-43fbaac5-a02d-4bc8-b48a-5f988f9f2349 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1645806dcdd41ea9c174bd4a9551899'} {{(pid=94756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 20:54:36.415637 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 629/1257] 10.222.0.23 () {58 vars in 1224 bytes} [Sat Oct 1 20:54:36 2022] DELETE /identity/v3/users/f1645806dcdd41ea9c174bd4a9551899 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 20:54:36.593206 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b136bb8b-0f28-40cd-8e6b-cd092aef5c23 service neutron] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:54:36.605283 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b136bb8b-0f28-40cd-8e6b-cd092aef5c23 service neutron] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:54:36.662376 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69c6885-ac18-4088-9daa-36316c05de02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f2619d8f534f3eace3cce529462560', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:54:36.663000 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69c6885-ac18-4088-9daa-36316c05de02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:54:36.663275 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69c6885-ac18-4088-9daa-36316c05de02 admin admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:54:36.663547 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69c6885-ac18-4088-9daa-36316c05de02 admin admin] PATH_INFO: `/v3/projects/ad6c25c90ba74647a7f4f821efe12045` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:54:36.664955 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69c6885-ac18-4088-9daa-36316c05de02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad6c25c90ba74647a7f4f821efe12045)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:54:36.666871 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69c6885-ac18-4088-9daa-36316c05de02 admin admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:54:36.712343 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.notifications [None req-b69c6885-ac18-4088-9daa-36316c05de02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad6c25c90ba74647a7f4f821efe12045', 'request_id': 'req-b69c6885-ac18-4088-9daa-36316c05de02'} {{(pid=94755) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 20:54:36.714788 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:54:36.719835 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.notifications [None req-b69c6885-ac18-4088-9daa-36316c05de02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad6c25c90ba74647a7f4f821efe12045', 'request_id': 'req-b69c6885-ac18-4088-9daa-36316c05de02'} {{(pid=94755) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 20:54:36.727072 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.notifications [None req-b69c6885-ac18-4088-9daa-36316c05de02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad6c25c90ba74647a7f4f821efe12045', 'request_id': 'req-b69c6885-ac18-4088-9daa-36316c05de02'} {{(pid=94755) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 20:54:36.738114 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.notifications [None req-b69c6885-ac18-4088-9daa-36316c05de02 admin admin] The token cache is being invalidate because project ad6c25c90ba74647a7f4f821efe12045 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=94755) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 20:54:36.738402 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.notifications [None req-b69c6885-ac18-4088-9daa-36316c05de02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=94755) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 20:54:36.739257 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.notifications [None req-b69c6885-ac18-4088-9daa-36316c05de02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=94755) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 20:54:36.740839 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 629/1258] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Oct 1 20:54:36 2022] DELETE /identity/v3/projects/ad6c25c90ba74647a7f4f821efe12045 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 20:54:36.745015 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fbaac5-a02d-4bc8-b48a-5f988f9f2349 admin admin] Authenticating user token {{(pid=94756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:54:36.746464 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.fernet_utils [None req-43fbaac5-a02d-4bc8-b48a-5f988f9f2349 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:54:36.759591 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fbaac5-a02d-4bc8-b48a-5f988f9f2349 admin admin] Validating token access rules against request {{(pid=94756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:54:36.815527 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db062902-e27d-447e-8940-f10ec2327e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f2619d8f534f3eace3cce529462560', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:54:36.816078 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db062902-e27d-447e-8940-f10ec2327e8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:54:36.816352 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db062902-e27d-447e-8940-f10ec2327e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:54:36.816694 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db062902-e27d-447e-8940-f10ec2327e8d admin admin] PATH_INFO: `/v3/users/f5674077fb5848cbb680cd10c0e23694` {{(pid=94756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:54:36.817800 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db062902-e27d-447e-8940-f10ec2327e8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5674077fb5848cbb680cd10c0e23694)` {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:54:36.819711 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db062902-e27d-447e-8940-f10ec2327e8d admin admin] RBAC: Authorization granted {{(pid=94756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:54:36.865635 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.notifications [None req-db062902-e27d-447e-8940-f10ec2327e8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5674077fb5848cbb680cd10c0e23694'} {{(pid=94756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 20:54:36.866279 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.notifications [None req-db062902-e27d-447e-8940-f10ec2327e8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5674077fb5848cbb680cd10c0e23694'} {{(pid=94756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 20:54:36.876714 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.notifications [None req-db062902-e27d-447e-8940-f10ec2327e8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5674077fb5848cbb680cd10c0e23694'} {{(pid=94756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 20:54:36.884021 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.notifications [None req-db062902-e27d-447e-8940-f10ec2327e8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5674077fb5848cbb680cd10c0e23694'} {{(pid=94756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 20:54:36.884709 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG keystone.notifications [None req-db062902-e27d-447e-8940-f10ec2327e8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5674077fb5848cbb680cd10c0e23694'} {{(pid=94756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 20:54:36.892552 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:54:36.904250 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: [pid: 94756|app: 0|req: 630/1259] 10.222.0.23 () {58 vars in 1224 bytes} [Sat Oct 1 20:54:36 2022] DELETE /identity/v3/users/f5674077fb5848cbb680cd10c0e23694 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 20:54:37.078862 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69c6885-ac18-4088-9daa-36316c05de02 admin admin] Authenticating user token {{(pid=94755) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 20:54:37.080446 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.fernet_utils [None req-b69c6885-ac18-4088-9daa-36316c05de02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94755) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 20:54:37.099724 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69c6885-ac18-4088-9daa-36316c05de02 admin admin] Validating token access rules against request {{(pid=94755) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 20:54:37.156447 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0ff87d-7bf7-4fe4-8c6e-8b322d70b642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59f4f70f764f57b1d8cf05402fdf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f2619d8f534f3eace3cce529462560', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94755) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 20:54:37.157108 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ff87d-7bf7-4fe4-8c6e-8b322d70b642 admin admin] REQUEST_METHOD: `DELETE` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 20:54:37.157382 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ff87d-7bf7-4fe4-8c6e-8b322d70b642 admin admin] SCRIPT_NAME: `/identity` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 20:54:37.157649 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ff87d-7bf7-4fe4-8c6e-8b322d70b642 admin admin] PATH_INFO: `/v3/projects/833ffd477dc641c0a663abe70a004618` {{(pid=94755) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 20:54:37.158774 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0ff87d-7bf7-4fe4-8c6e-8b322d70b642 admin admin] RBAC: Authorizing `identity:delete_project(project_id=833ffd477dc641c0a663abe70a004618)` {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 20:54:37.161266 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0ff87d-7bf7-4fe4-8c6e-8b322d70b642 admin admin] RBAC: Authorization granted {{(pid=94755) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 20:54:37.209316 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.notifications [None req-bb0ff87d-7bf7-4fe4-8c6e-8b322d70b642 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '833ffd477dc641c0a663abe70a004618', 'request_id': 'req-bb0ff87d-7bf7-4fe4-8c6e-8b322d70b642'} {{(pid=94755) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 20:54:37.216299 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.notifications [None req-bb0ff87d-7bf7-4fe4-8c6e-8b322d70b642 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '833ffd477dc641c0a663abe70a004618', 'request_id': 'req-bb0ff87d-7bf7-4fe4-8c6e-8b322d70b642'} {{(pid=94755) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 20:54:37.221858 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.notifications [None req-bb0ff87d-7bf7-4fe4-8c6e-8b322d70b642 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '833ffd477dc641c0a663abe70a004618', 'request_id': 'req-bb0ff87d-7bf7-4fe4-8c6e-8b322d70b642'} {{(pid=94755) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 20:54:37.233557 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.notifications [None req-bb0ff87d-7bf7-4fe4-8c6e-8b322d70b642 admin admin] The token cache is being invalidate because project 833ffd477dc641c0a663abe70a004618 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=94755) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 20:54:37.233847 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.notifications [None req-bb0ff87d-7bf7-4fe4-8c6e-8b322d70b642 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=94755) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 20:54:37.234483 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG keystone.notifications [None req-bb0ff87d-7bf7-4fe4-8c6e-8b322d70b642 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=94755) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 20:54:37.235956 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: [pid: 94755|app: 0|req: 630/1260] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Oct 1 20:54:37 2022] DELETE /identity/v3/projects/833ffd477dc641c0a663abe70a004618 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 20:54:46.903635 dv-osbrick-master-4-ceph devstack@keystone.service[94756]: DEBUG dbcounter [-] [94756] Writing DB stats keystone:SELECT=3,keystone:DELETE=1 {{(pid=94756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:54:47.230630 dv-osbrick-master-4-ceph devstack@keystone.service[94755]: DEBUG dbcounter [-] [94755] Writing DB stats keystone:DELETE=10,keystone:SELECT=57,keystone:INSERT=1 {{(pid=94755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}